JP2019125153A - Safe driving assist unit and helmet - Google Patents

Abstract

To provide a safe driving assist unit and a helmet that assist safe driving by preventing cancellation of a turn signal lamp from being forgotten, .SOLUTION: A safe driving assist unit 101 uses a photographic image which is taken by a camera 102 mounted on a helmet 110, and data which relates to a motion detected by a sensor 103, to monitor a traveling state of a motorcycle BK and an operating state of a turn signal lamp of the motorcycle BK. If the turn signal lamp remains lit when turning to the right or left or changing courses in a direction for which the turn signal lamp of the motorcycle BK is lit is completed, the safe driving assist unit 101 outputs an alert to a person wearing the helmet 110.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a safe driving support device and a helmet.

  Motorcycles (motorcycles, motorbikes, etc.) are turned mainly by the weight shift of the driver, not by steering like a car when turning left or right. For this reason, in a motorcycle, a release mechanism of a turn signal interlocked with a steering wheel such as a car is often not implemented.

  In the prior art, for example, a helmet is provided with a camera for photographing the front, and image information for an estimated time before and after when an impact larger than an expected value is given by an acceleration sensor is stored in an image memory. In addition, a technique is provided that includes an on-vehicle camera for capturing the front of the vehicle and performs image processing on an image in front of the vehicle captured by the on-vehicle camera to determine whether the friction coefficient of the road surface in the traveling direction may decrease. is there. In addition, the target determined as a vehicle should be warned based on the condition of the vehicle and the target (for example, a surrounding vehicle, an obstacle) to which the driver of the vehicle should pay attention, which is determined by image analysis of the image of the shooting camera There is a technique of giving a warning to the driver of the vehicle when it is determined that the positional relationship is established.

JP, 2010-148718, A JP, 2016-193660, A JP, 2015-101150, A

  However, in the prior art, when the driver makes a left turn or changes the course on a motorcycle, the driver may not notice the forgetting to release the turn indicator, which may cause a problem in safe driving.

  In one aspect, the present invention aims to support safe driving by preventing forgetting to release the turn signal.

  In one embodiment, it is determined based on a captured image captured by a camera mounted on a helmet whether a turn indicator of a running vehicle has turned on and it is determined that the turn indicator has turned on. In this case, based on the data on the movement detected by the sensor mounted on the helmet, it is determined whether a turn or turn to the direction in which the turn indicator is lit has been completed, and a right to the direction If it is determined that the left turn or the course change has been completed, it is determined whether or not the turn signal is on based on the captured image captured by the camera, and it is determined that the turn signal is on. A safe driving support device is provided that outputs an alert for the wearer of the helmet when it occurs.

  In one embodiment, a helmet worn by a driver of a vehicle includes a range including an indicator light indicating an operating state of a turn indicator of the vehicle when a wearer of the helmet drives the vehicle. It is determined based on a camera capable of imaging, a sensor for detecting data related to movement, and a captured image captured by the camera whether or not a direction indicator of the traveling vehicle is lit, and the direction indicator When it is determined that the light has turned on, it is determined based on the data on the movement detected by the sensor whether turning or turning to the direction in which the turn indicator has turned on has been completed or not. If it is determined that a turn or turn has been completed, it is determined based on the captured image captured by the camera whether the direction indicator is on or not, and the direction indicator is determined If it is determined to be lit, helmet with a safety driving support apparatus that outputs an alert to the wearer of the helmet is provided.

  According to one aspect of the present invention, it is possible to prevent the forgetting of release of the turn signal and to support safe driving.

FIG. 1 is an explanatory view showing an example of the safe driving support device 101 according to the embodiment. FIG. 2 is a block diagram showing an example of the hardware configuration of the safe driving support device 101. As shown in FIG. FIG. 3 is an explanatory view showing an example of a captured image. FIG. 4 is an explanatory view showing an example of the storage content of the meter panel image DB 400. As shown in FIG. FIG. 5 is a block diagram showing a functional configuration example of the safe driving support device 101. As shown in FIG. FIG. 6 is an explanatory view showing an example of monitoring of the lighting state of the direction indicator of the motorcycle BK. FIG. 7 is an explanatory view showing an example of an image of the speedometer 303. As shown in FIG. FIG. 8 is a flowchart (part 1) illustrating an example of the safe driving support processing procedure of the safe driving support device 101. FIG. 9 is a flowchart (part 2) illustrating an example of the safe driving support processing procedure of the safe driving support device 101.

  Hereinafter, embodiments of the safe driving support device and the helmet according to the present invention will be described in detail with reference to the drawings.

Embodiment
FIG. 1 is an explanatory view showing an example of the safe driving support device 101 according to the embodiment. In FIG. 1, the safe driving support device 101 is a computer that is mounted on the helmet 110 and supports the safe driving of the wearer of the helmet 110. The helmet 110 is for protecting the head from impact and the like, and is worn by the driver of the vehicle.

  Examples of the helmet 110 include a full-face helmet, a system helmet, and a jet helmet. The vehicle is, for example, a motorcycle such as a motorcycle or a motorbike. However, the vehicle may be a three-wheeled motorcycle such as a trike. In the following description, a vehicle driven by a wearer of the helmet 110 may be referred to as “bike BK”.

  A camera 102 and a sensor 103 are mounted on the helmet 110. The camera 102 is attached at a position where it can capture an area including an indicator light that indicates the operating state of the direction indicator of the bike BK when the wearer of the helmet 110 drives the bike BK. The direction indicator (turn signal) is a device that displays the bending direction of the motorcycle BK, and is provided, for example, at both ends of the motorcycle BK.

  The sensor 103 is a device that detects data related to movement, and is, for example, an acceleration sensor 203 or a tilt sensor 204 shown in FIG. 2 described later. According to the sensor 103, data relating to the movement of the wearer of the helmet 110, for example, data relating to acceleration and tilt can be acquired.

  Further, the helmet 110 is equipped with, for example, a speaker 104, a light emitting diode (LED) light 105, and a vibrator 106 as an output device for notifying the wearer of an alert. The description of the speaker 104, the LED light 105, and the vibrator 106 will be described later with reference to FIG.

  Here, motorcycle drivers are required to wear a helmet. However, when wearing a helmet, the field of view is narrower than when the helmet is not worn, and various meters and indicator lights on the steering wheel often can not be seen unless the head is turned down. For this reason, when the helmet is worn, confirmation of the operating state of the speedometer or the direction indicator by the driver may be delayed.

  On the other hand, in a motorcycle, the release mechanism of the turn signal indicator interlocked with the steering wheel such as a car is not implemented, and the driver consciously releases the turn signal indicator upon completion of turning or the like. Therefore, if you forget to release the turn signal at the completion of a turn, etc., it will be delayed for the driver to notice forgetting the release, and it will be in a state where the direction instruction is issued, and not only your own vehicle but Including, there is a risk of affecting the safe driving.

  Therefore, in the present embodiment, the safe driving support device 101 monitors the traveling state of the motorcycle BK and the operating state of the direction indicator of the motorcycle BK using the camera 102 and the sensor 103 mounted on the helmet 110. Then, the safe driving support device 101 alerts the wearer of the helmet 110 when the turn indicator remains on even if turning or turning to the direction in which the turn indicator on the bike BK has turned on is completed. Output. In this way, the driver (driver) of the helmet 110 can prevent the user from forgetting to release the direction indicator to support safe driving.

(Hardware configuration example of the safe driving support device 101)
Next, a hardware configuration example of the safe driving support device 101 will be described.

  FIG. 2 is a block diagram showing an example of the hardware configuration of the safe driving support device 101. As shown in FIG. In FIG. 2, the safe driving support apparatus 101 includes a central processing unit (CPU) 201, a memory 202, an acceleration sensor 203, an inclination sensor 204, a camera 102, a speaker 104, an LED light 105, and a vibrator 106. And. Also, each component is connected by a bus 200.

  Here, the CPU 201 is in charge of overall control of the safe driving support device 101. The CPU 201 may have a plurality of cores. The memory 202 includes, for example, a read only memory (ROM), a random access memory (RAM), and a flash ROM. Specifically, for example, a flash ROM or a ROM stores various programs, and a RAM is used as a work area of the CPU 201. The program stored in the memory 202 is loaded into the CPU 201 to cause the CPU 201 to execute the coded processing.

  The acceleration sensor 203 is a device that measures acceleration. The acceleration sensor 203 is, for example, a three-axis acceleration sensor that measures acceleration in three directions (traveling direction, left and right direction, vertical direction) of the XYZ axes. The tilt sensor 204 is a device that detects data related to the tilt. The tilt sensor 204 is, for example, a gyroscope that detects the orientation or angular velocity of an object.

  The camera 102 is an imaging device that captures an image and outputs image information. The camera 102 is attached to the front of the helmet 110, as shown in FIG. 2, and includes an indicator light that indicates the operating state of the direction indicator of the bike BK when the wearer of the helmet 110 drives the bike BK. Can be taken. The frame rate of the camera 102 is, for example, about 30 fps.

  The speaker 104 is a device that converts an electrical signal into sound. The speakers 104 are respectively attached around the left and right ears of the wearer of the helmet 110 as shown in FIG. 2, for example. For example, an alert sound or an alert message is output from the speaker 104.

  The LED light 105 is a device that emits light. The LED light 105 is mounted, for example, at a position that does not interfere with the visibility of the wearer of the helmet 110, as shown in FIG. The vibrator 106 is a vibrating device that vibrates. The vibrator 106 is provided, for example, around the neck and cheek portions of the wearer of the helmet 110, as shown in FIG.

  The safe driving support apparatus 101 may have, for example, a timer, a communication I / F (Interface), an input device, a display device, a GPS (Global Positioning System) unit, and the like in addition to the above-described components. . In addition, the safe driving support device 101 may have at least one of the speaker 104, the LED light 105, and the vibrator 106, and may not have the LED light 105 or the vibrator 106, for example.

  In the above description, although the acceleration sensor 203, the tilt sensor 204, the camera 102, the speaker 104, the LED light 105, and the vibrator 106 are described as components included in the safe driving support device 101, the present invention is not limited thereto. For example, the acceleration sensor 203 or the like may be provided as a device different from the safe driving support device 101, and may be mounted on the helmet 110 so as to be communicable with the safe driving support device 101.

(Image captured by camera 102)
Next, a captured image captured by the camera 102 will be described.

  FIG. 3 is an explanatory view showing an example of a captured image. In FIG. 3, a captured image 300 is an example of a captured image captured by the camera 102 when the wearer of the helmet 110 drives the motorcycle BK. However, in the example of FIG. 3, the display of the wearer of the helmet 110 (for example, the hand or arm holding the handle of the bike BK, etc.) is omitted.

  In the captured image 300, indicator lights 301 and 302 indicating the operating state of the direction indicator of the motorcycle BK, a speedometer 303, and a tachometer 304 are shown. The indicator light 301 is turned on when the turn signal on the left side of the motorcycle BK is turned on, that is, the turn signal indicates the left direction. The indicator light 302 is turned on when the turn signal on the right side of the bike BK is on, that is, the turn signal indicates the right direction.

  In the captured image 300, both the indicator lights 301 and 302 are turned off. That is, the captured image 300 is an image when the direction indicator of the motorcycle BK is not lighted on both sides.

(Contents stored in meter panel image DB 400)
Below, the memory content of meter panel image DB400 which safe driving assistance device 101 uses is demonstrated. The meter panel image DB 400 is stored, for example, in the memory 202 of the safe driving support device 101 shown in FIG.

  FIG. 4 is an explanatory view showing an example of the storage content of the meter panel image DB 400. As shown in FIG. In FIG. 4, the meter panel image DB 400 has fields of a vehicle ID, an unlit image, a left lit image, and a right lit image, and by setting information in each field, meter panel image information (for example, meter panel image information 401) is stored.

  Here, the vehicle ID is an identifier for identifying the motorcycle BK. The light-off image is a vertical image of the meter panel when the direction indicator of the motorcycle BK is turned off both at the left and right. The meter panel is an instrument panel of the motorcycle BK, and includes the indicator lights 301 and 302, the speedometer 303, and the tachometer 304 shown in FIG.

  The left-lit image is a trapezoid image of the meter panel when the indicator lamp 301 is lit. That is, the left lighted image corresponds to the image of the meter panel when the left turn indicator of the motorcycle BK is lighted. The right lighting image is a trapezoid image of the meter panel when the indicator light 302 is on. That is, the right lighting image corresponds to the image of the meter panel when the right turn indicator of the motorcycle BK is on.

  The meter panel image information may be created, for example, in another device different from the safe driving support device 101 and recorded in advance in the safe driving support device 101. Also, the wearer of the helmet 110 may set up when starting to drive the motorcycle BK. Describing in more detail, for example, the safe driving support device 101 instructs the wearer of the helmet 110 to sequentially turn on the left and right direction indicators of the motorcycle BK, thereby turning off the image, the left light image, and the right light image. In order to create meter panel image information. The instruction to the wearer of the helmet 110 is given, for example, by voice guidance from the speaker 104 shown in FIGS. 1 and 2.

(Functional configuration example of the safe driving support device 101)
FIG. 5 is a block diagram showing a functional configuration example of the safe driving support device 101. As shown in FIG. In FIG. 5, the safe driving support device 101 includes an acquisition unit 501, a first monitoring unit 502, a second monitoring unit 503, a determination unit 504, and an output unit 505. The acquiring unit 501 to the output unit 505 are functions as a control unit, and more specifically, for example, the CPU 201 executes a program stored in the memory 202 illustrated in FIG. 2 to realize the functions. The processing result of each functional unit is stored, for example, in the memory 202.

  The acquisition unit 501 acquires a captured image captured by the camera 102 (see FIGS. 1 and 2). Specifically, for example, each time the captured image is captured by the camera 102, the obtaining unit 501 may obtain the captured image. In addition, the acquisition unit 501 may acquire a captured image for a predetermined time captured by the camera 102 every predetermined time (for example, one second).

  In addition, the acquisition unit 501 acquires data on the motion detected by the sensor 103 (see FIG. 1). The sensor 103 is, for example, the acceleration sensor 203 or the inclination sensor 204 shown in FIG. Specifically, for example, the acquisition unit 501 acquires data related to the acceleration measured by the acceleration sensor 203. In addition, the acquisition unit 501 acquires data on the inclination detected by the inclination sensor 204.

  The first monitoring unit 502 monitors the lighting state of the direction indicator of the bike BK based on the captured image captured by the camera 102. Specifically, for example, the first monitoring unit 502 specifies the meter panel image information corresponding to the motorcycle BK with reference to the meter panel image DB 400 shown in FIG. 4. Next, the first monitoring unit 502 uses the existing pattern matching technology or the like to add to the captured image captured by the camera 102 either the left lit image or the right lit image of the identified meter panel image information. It is determined whether or not a substantially coincident portion is included.

  Here, in the case where the part substantially corresponding to either the left lighting image or the right lighting image is included, the first monitoring unit 502 determines that the direction indicator of the motorcycle BK has been lit. For example, in the case where a portion that substantially matches the left lighting image is included, the first monitoring unit 502 determines that the left turn indicator of the motorcycle BK has been turned on. On the other hand, when the part substantially corresponding to the right lighting image is included, the first monitoring unit 502 determines that the right turn indicator of the motorcycle BK is turned on.

  The meter panel image DB 400 may store a plurality of meter panel image information, for example, meter panel image information of different vehicle types. In this case, the first monitoring unit 502 may specify the meter panel image information corresponding to the selected vehicle ID by, for example, accepting the selection of the vehicle ID of the motorcycle BK with an input device (not shown). Good. Further, when the wearer of the helmet 110 starts driving the bike BK, the first monitoring unit 502 determines meter panel image information corresponding to the bike BK from the captured image captured by the camera 102. May be Describing in more detail, first, the first monitoring unit 502 acquires a captured image of the meter panel when the direction indicator is turned off both at the time of starting operation. Next, the first monitoring unit 502 searches the meter panel image DB 400 for a extinguished image that substantially matches the acquired captured image. Then, the first monitoring unit 502 specifies meter panel image information including the searched-out image as meter panel image information corresponding to the bike BK.

  Here, an example of monitoring the lighting state of the direction indicator of the motorcycle BK will be described with reference to FIG. Here, the meter panel image information 401 shown in FIG. 4 will be described as an example of the meter panel image information corresponding to the motorcycle BK.

  FIG. 6 is an explanatory view showing an example of monitoring of the lighting state of the direction indicator of the motorcycle BK. In (6-1) of FIG. 6, captured images 611 to 614 are captured images for a predetermined time captured by the camera 102. The fixed time is, for example, about 2 seconds. However, in FIG. 6, a part of a series of captured images captured by the camera 102 is extracted and displayed.

  The first monitoring unit 502 detects, from the captured images 611 to 614, a captured image including a portion that substantially matches either the left lighting image or the right lighting image of the meter panel image information 401. Here, the captured image 612 and the captured image 614 are detected as a captured image including a portion that substantially matches the left lighting image of the meter panel image information 401.

  In this case, the first monitoring unit 502 determines that the left turn indicator of the motorcycle BK has been turned on. Note that, for example, as illustrated in (6-1) of FIG. 6, the first monitoring unit 502 includes captured images 612 and 614 including a portion substantially corresponding to the left lighting image and a captured image 611 not including the portion. , 613 alternately appear, it may be determined that the left turn indicator on the motorcycle BK has been turned on.

Returning to the explanation of FIG. 5, the second monitoring unit 503 monitors the traveling state of the motorcycle BK based on the data on the movement detected by the sensor 103. Specifically, for example, if the measurement result of acceleration in at least one of three directions (traveling direction, left and right direction, up and down direction) of the XYZ axes is equal to or more than the threshold value α, the second monitoring unit 503 It may be determined that BK is traveling. The threshold value α can be arbitrarily set, and is set to, for example, 0 [m / s ² ].

  In addition, the second monitoring unit 503 may monitor the traveling state of the motorcycle BK based on the captured image captured by the camera 102. Specifically, for example, the second monitoring unit 503 extracts the image of the speedometer 303 from the captured image captured by the camera 102. In addition, the position of the image of the speedometer 303 in a captured image is specified from display of a shape (circle), a number, a unit (km / h), etc., for example.

  Then, based on the extracted image of the speedometer 303, the second monitoring unit 503 determines whether the speed instructed by the speedometer 303, that is, the speed indicated by the meter needle is equal to or more than the threshold value β. Then, if the speed is equal to or higher than the threshold value β, the second monitoring unit 503 may determine that the motorcycle BK is traveling. The threshold value β can be set arbitrarily, for example, 10 [km / h].

  The second monitoring unit 503 may monitor the traveling state of the motorcycle BK based on, for example, an output value from a GPS unit (not shown). Specifically, for example, the second monitoring unit 503 calculates the speed of the bike BK based on the output value from the GPS unit (not shown), and if the calculated speed is equal to or more than the threshold value β, the bike BK is It may be determined that the vehicle is traveling.

  In addition, the second monitoring unit 503 may monitor the traveling state of the motorcycle BK on the basis of data regarding the movement detected by the sensor 103 and the captured image captured by the camera 102. Specifically, for example, if the measurement result of the acceleration in at least one of the three directions of the XYZ axes is equal to or higher than the threshold α and the speed is equal to or higher than the threshold β, for example, the second monitoring unit 503 It may be determined that BK is traveling. Further, the second monitoring unit 503 may capture the surroundings with another camera different from the camera 102, analyze the captured image captured by the other camera, and monitor the traveling state of the motorcycle BK. Good.

  Here, a monitoring example of the traveling state of the motorcycle BK based on the captured image captured by the camera 102 will be described using FIG. 7. Here, the threshold value β is set to “β = 10 [km / h]”.

  FIG. 7 is an explanatory view showing an example of an image of the speedometer 303. As shown in FIG. In FIG. 7, the speedometer image 700 is an example of the image of the speedometer 303 of the motorcycle BK extracted from the captured image captured by the camera 102.

  The second monitoring unit 503 analyzes the speedometer image 700 to specify the speed indicated by the meter hand 701 of the speedometer 303. Here, the speed "20 [km / h]" is specified. Next, the second monitoring unit 503 determines whether the specified speed is equal to or more than the threshold value β. Here, the second monitoring unit 503 determines that the motorcycle BK is traveling because the specified speed is equal to or higher than the threshold value β.

  The second monitoring unit 503 determines, for example, whether the meter hand 701 exceeds the dotted line 702, and if the meter hand 701 exceeds the dotted line 702, determines that the motorcycle BK is traveling. It may be good. A dotted line 702 is a dividing line set on the image according to the threshold value β, and indicates a velocity “10 [km / h]” corresponding to the threshold value β. The position where the dotted line 702 is set on the image is specified from, for example, the display of a memory, a number, or the like.

  Returning to the description of FIG. 5, the determination unit 504 determines whether the direction indicator of the traveling motorcycle BK has been lit. Specifically, for example, the determination unit 504 determines that the first monitoring unit 502 determines that the direction indicator of the motorcycle BK has been turned on, and the second monitoring unit 503 determines that the motorcycle BK is traveling. When it is determined, it is determined that the direction indicator of the running motorcycle BK has turned on.

  In addition, when the direction indicator of the motorbike BK being driven is turned on, the determination unit 504 completes the left / right turn or route change in the direction in which the direction indicator is turned on based on the data related to the movement detected by the sensor 103 Determine if you Here, turning to the left or right means turning to the right or to the left. The course change is to change the course while advancing in the same direction, for example, to move from the current lane to another lane (so-called lane change) when there are multiple lanes.

  Specifically, for example, when the direction indicator of the traveling motorcycle BK is turned on, the determination unit 504 tilts in the direction in which the direction indicator is turned on, based on the data related to the inclination detected by the inclination sensor 204 It is determined whether or not is detected. More specifically, for example, if the inclination angle to the direction in which the direction indicator is lit is 5 degrees or more, the determination unit 504 determines that the inclination to the direction in which the direction indicator is lit is detected. The inclination angle is an angle at which the object (wearer of the helmet 110) is inclined, and in this case, is an angle with respect to the vertical direction.

  Here, when the tilt in the direction in which the turn indicator is lit is detected, the determination unit 504 eliminates the tilt in the direction in which the turn indicator is lit based on the data on the tilt detected by the tilt sensor 204 Determine if it has been done. However, it takes some time for the inclination to be eliminated.

  For this reason, the determination unit 504 may wait for a certain period of time t until the inclination in the direction in which the turn indicator is lit is eliminated. The fixed time t can be set arbitrarily, and is set to, for example, a time of about 5 seconds. Then, when the inclination in the direction in which the turn indicator has been turned on has been cancelled, the determination unit 504 may determine that turning or turning to the direction in which the turn indicator has turned on has been completed.

  In addition, when it is determined that the first monitoring unit 502 has completed turning or turning in the direction in which the turn indicator has lighted, the first monitoring unit 502 instructs the direction of the motorcycle BK based on the captured image captured by the camera 102 It is judged whether the device is on or not. Specifically, for example, the first monitoring unit 502 is a portion that substantially matches the left lighting image or the right lighting image in at least one of the captured images for a predetermined time (about 2 seconds) captured by the camera 102 To determine whether or not

  The first monitoring unit 502 indicates that the direction indicator of the bike BK is on when none of the captured images for a predetermined time includes a portion that substantially matches the left-on image or the right-on image. I will not judge. That is, the first monitoring unit 502 determines that the direction indicator of the motorcycle BK has been extinguished.

  Here, as a captured image for a predetermined time (for example, 2 seconds) captured by the camera 102, captured images 621 to 624 shown in (6-2) of FIG. 6 will be described as an example. However, in FIG. 6, a part of a series of captured images captured by the camera 102 is extracted and displayed.

  In this case, the first monitoring unit 502 detects, from the captured images 621 to 624, a captured image including a portion that substantially matches the left lighting image or the right lighting image of the meter panel image information 401. Here, none of the captured images 621 to 624 is detected. In this case, the first monitoring unit 502 determines that the direction indicator of the motorcycle BK is not on.

  Note that the first monitoring unit 502 may determine whether or not each captured image for a predetermined time captured by the camera 102 includes a portion that substantially matches the unlit image. Then, the first monitoring unit 502 may determine that the direction indicator of the motorcycle BK is not on when all the captured images for a predetermined time include a portion that substantially matches the off image. Good.

  When it is determined by the first monitoring unit 502 that the turn indicator of the motorcycle BK is on after the output unit 505 determines that the right / left turn or course change has been completed by the determination unit 504, the helmet 110 is selected. Output a first alert for the wearer of

  Here, the first alert is a warning that warns the wearer of the helmet 110 that the direction indicator has been released. That is, even if turning or turning in the direction in which the direction indicator of the bike BK lights up is completed but the direction indicator of the bike BK does not go out, the output unit 505 performs the first alert. Output.

  However, it may stop on the road shoulder etc. after turning or turning to the direction in which the turn signal lights up is completed or course change is completed. In such a case, the wearer of the helmet 110 is often parked on the road shoulder while intentionally giving a direction indication, and it is possible to warn the wearer of the helmet 110 that the direction indicator has been released. It can be an over alert.

  For this reason, the second monitoring unit 503 uses the motorcycle BK based on the data on the movement detected by the sensor 103 when it is determined that the turning or turning to the direction in which the turn indicator turns on is completed. It may be determined whether or not the vehicle is traveling. Here, if it is determined that the motorcycle BK is not traveling, it can be said that the vehicle is stopped at a road shoulder or the like after turning or turning to the direction in which the direction indicator is lit is completed.

  When the first monitoring unit 502 determines that the turn indicator of the motorcycle BK is on, and the second monitoring unit 503 determines that the motorcycle BK is traveling. The first alert may be output. Thereby, when the wearer of the helmet 110 intentionally stops on the road shoulder with the direction indication, for example, it is possible to prevent a warning that warns of forgetting to release the direction indicator.

  Specifically, for example, the output unit 505 may output an alert sound or an alert message from the speaker 104 mounted on the helmet 110 as a first alert. The alert sound is, for example, a monotonous rhythm sound such as a buzzer sound. The alert message is a voice message prompting confirmation of the operating state of the turn signal, for example, a voice message such as "Do you forget to release the turn signal?" However, as the alert sound and the type and volume of the alert message, those not affecting the operation of the motorcycle BK are set.

  This makes it possible to warn of the forgetting of the release of the turn signal through the hearing of the wearer of the helmet 110.

  In addition, the output unit 505 may turn on the LED light 105 mounted on the helmet 110 as a first alert. The lighting pattern of the LED light 105 can be set arbitrarily. However, as the lighting pattern, a pattern which does not disturb the operation of the motorcycle BK is set.

  Thereby, it is possible to warn the user of the helmet 110 of the forgetting to release the direction indicator through the vision of the wearer.

  In addition, the output unit 505 may vibrate the vibrator 106 mounted on the helmet 110 as a first alert. The vibration pattern of the vibrator 106 can be set arbitrarily. However, as the vibration pattern, a vibration pattern that does not disturb the operation of the motorcycle BK is set.

  This makes it possible to warn of the forgetting of the release of the turn signal through the touch of the wearer of the helmet 110.

  Also, the output unit 505 may output the first alert when it is determined that the direction indicator of the motorcycle BK has been turned on and the direction indicator has been turned on continuously for a predetermined time T. Good. The predetermined time T can be set arbitrarily, for example, based on a typical time from the activation of the turn indicator on the bike BK to the completion of turning or turning or turning and releasing the turn indicator. Set to As an example, the predetermined time T is set to about 30 seconds to 60 seconds.

  As a result, even if the turn indicator remains on after turning or turning in the direction in which the turn indicator on the bike BK is lit, the predetermined time T has elapsed since the turn indicator has been turned on. It is possible not to output the first alert until it has elapsed.

  In addition, after the first monitoring unit 502 determines that the direction indicator of the motorcycle BK has been turned on, the elapsed time x from when it is determined that the direction indicator is not turned on is recorded in the memory 202. It is also good. The elapsed time x is measured, for example, by a timer (not shown).

  Here, the first timing determined by the first monitoring unit 502 that the turn indicator of the bike BK has been turned on corresponds to the timing at which the wearer of the helmet 110 operates the turn indicator of the bike BK. On the other hand, after the first monitoring unit 502 determines that the direction indicator of the bike BK is turned on, the second timing determined that the direction indicator of the bike BK is not turned on is wearing of the helmet 110. This corresponds to the timing at which the person released the direction indicator of the bike BK.

  That is, the elapsed time x from the first timing to the second timing is the time taken from the activation of the turn indicator of the bike BK to the completion of turning or turning or turning of the turn signal and releasing the turn indicator. Equivalent to. Specifically, for example, the first monitoring unit 502 records the elapsed time x measured by a timer (not shown) in the memory 202 in an array format.

  Then, the first monitoring unit 502 may determine the predetermined time T based on the elapsed time x accumulated in the memory 202. However, after outputting the first alert, the first monitoring unit 502 excludes the elapsed time x when it is determined that the turn indicator has not been turned on. That is, the wearer of the helmet 110 notices forgetting to release the turn indicator by the first alert and does not consider the elapsed time x when the turn indicator is released.

  Specifically, for example, the first monitoring unit 502 may determine the average value of the elapsed times x accumulated in the memory 202 as the predetermined time T. At this time, the first monitoring unit 502 may use, for example, a predetermined number (for example, five) of elapsed times x when the time stored in the memory 202 is new.

  As an example, the elapsed time x accumulated in the memory 202 is [35, 40, 39, 35, 38] (unit: second). In this case, the first monitoring unit 502 determines, for example, the average value “37.4 [seconds]” of the elapsed time x accumulated in the memory 202 as the predetermined time T. In this case, the output unit 505 outputs the first alert when the direction indicator is continuously lit for 37.4 seconds after it is determined that the direction indicator of the running motorcycle BK is lit. Do.

  As a result, the predetermined time T can be determined from the actual elapsed time x from when the wearer of the helmet 110 activates the turn indicator to when the direction indicator is released without warning.

  In addition, while stopping at the road shoulder etc., in many cases, the direction indication is intentionally left. For this reason, even if the first monitoring unit 502 determines that the direction indicator of the motorcycle BK is not lit, it is not determined that the motorcycle BK is traveling by the second monitoring unit 503. The elapsed time x may not be recorded.

  In addition, the output unit 505 may output a second alert for the wearer of the helmet 110 when the inclination in the direction opposite to the direction in which the direction indicator of the motorcycle BK lights is detected. Here, the second alert is a warning that prompts the wearer of the helmet 110 to confirm the direction indicated by the direction indicator.

  Specifically, for example, the output unit 505 may output an alert sound or an alert message from the speaker 104 mounted on the helmet 110 as a second alert. However, the alert sound and alert message types are set different from those of the first alert. For example, the alert message is a voice message such as "Do you make a wrong direction?"

  Thereby, through the hearing of the wearer of the helmet 110, it is possible to urge confirmation of the direction indicated by the direction indicator.

  In addition, the output unit 505 may turn on the LED light 105 mounted on the helmet 110 as a second alert. However, the lighting pattern of the LED light 105 is set to be different from the first alert. Thereby, through the vision of the wearer of the helmet 110, confirmation of the direction indicated by the direction indicator can be promoted.

  In addition, the output unit 505 may vibrate the vibrator 106 mounted on the helmet 110 as a second alert. However, the vibration pattern of the vibrator 106 is set to be different from the first alert. As a result, it is possible to urge confirmation of the direction indicated by the direction indicator through the sense of touch of the wearer of the helmet 110.

  The camera 102 may be attached to a position where the range including the direction indicator itself of the bike BK can be imaged when the wearer of the helmet 110 drives the bike BK. In this case, the first monitoring unit 502 may use, instead of the unlit image of the meter panel image information, a trapezoidal image in which the direction indicator turned off both on the left and right is captured. In addition, the first monitoring unit 502 may use, instead of the left lighting image of the meter panel image information, a trapezoidal image in which a direction indicator whose left side is lighting is captured. Further, instead of the right lighting image of the meter panel image information, the first monitoring unit 502 may use a trapezoid image in which a direction indicator whose right side is lighting is captured.

(Safe driving support processing procedure of the safe driving support apparatus 101)
Next, the safe driving support processing procedure of the safe driving support device 101 will be described. The safe driving support device 101 starts the execution of the safe driving support processing, for example, in response to the reception of the start instruction of the safe driving support processing by the input device (not shown).

  8 and 9 are flowcharts showing an example of the safe driving support processing procedure of the safe driving support device 101. In the flowchart of FIG. 8, first, the safe driving support apparatus 101 monitors the traveling state of the motorcycle BK and the lighting state of the direction indicator of the motorcycle BK based on the captured image captured by the camera 102 (step S801).

  Then, the safe driving support device 101 determines whether the motorcycle BK is traveling and the direction indicator of the motorcycle BK is lit (step S802). Here, when it is not determined that the motorcycle BK is traveling and the direction indicator of the motorcycle BK is on (Step S802: No), the safe driving support device 101 returns to Step S801.

  On the other hand, when it is determined that the motorcycle BK is traveling and the direction indicator of the motorcycle BK is turned on (step S802: Yes), the safe driving support device 101 starts measurement of the elapsed time x by the timer ( Step S803). Next, the safe driving support device 101 determines, based on data on the tilt detected by the tilt sensor 204, whether the tilt in the left-right direction has been detected (step S804).

  Here, when the inclination in the left-right direction is detected (step S804: Yes), the safe driving support apparatus 101 determines whether the detected inclination is the inclination in the direction in which the turn indicator is lit. (Step S805). Then, in the case of the tilt in the direction in which the turn indicator is lit (step S805: Yes), the safe driving support device 101 proceeds to step S901 shown in FIG.

  On the other hand, when the direction indicator does not tilt in the direction of lighting (step S805: No), the safe driving support device 101 outputs a second alert for the wearer of the helmet 110 (step S806), as shown in FIG. It transfers to step S905 shown to. The second alert is a warning that prompts the wearer of the helmet 110 to confirm the direction indicated by the direction indicator.

  In step S804, when inclination to the left and right is not detected (step S804: No), the safe driving support device 101 determines whether the elapsed time x has exceeded the predetermined time T (step S807). . Here, when the elapsed time x does not exceed the predetermined time T (step S807: No), the safe driving support device 101 returns to step S804.

  On the other hand, when the elapsed time x exceeds the predetermined time T (step S 807: Yes), the safe driving support device 101 determines whether the motorcycle BK is traveling and the direction indicator of the motorcycle BK is on or not. (Step S808). Here, when it is not determined that the motorcycle BK is traveling and the direction indicator of the motorcycle BK is on (step S808: No), the safe driving support device 101 performs step S905 illustrated in FIG. Migrate to

  On the other hand, when it is determined that the motorcycle BK is traveling and the direction indicator of the motorcycle BK is on (step S808: Yes), the safe driving support device 101 performs the first operation on the wearer of the helmet 110. The alert is output (step S809), and the process proceeds to step S905 shown in FIG. The first alert is a warning that warns the wearer of the helmet 110 that the direction indicator has been released.

  In the flowchart of FIG. 9, first, the safe driving support apparatus 101 determines whether the tilt in the direction in which the turn indicator is lit has been eliminated based on the data on the tilt detected by the tilt sensor 204 (step S901).

  Here, when the inclination in the direction in which the turn indicator has been turned on has been canceled (step S901: Yes), the safe driving support device 101 is running a bike BK and the turn indicator on the bike BK is turned on It is determined whether or not it is (step S902).

  Here, when the motorcycle BK is traveling and the direction indicator of the motorcycle BK is on (step S902: Yes), the safe driving support device 101 determines whether the elapsed time x has exceeded the predetermined time T or not. It is determined (step S903). Here, when the elapsed time x does not exceed the predetermined time T (step S903: No), the safe driving support device 101 returns to step S902.

  On the other hand, when the elapsed time x exceeds the predetermined time T (step S903: Yes), the safe driving support device 101 outputs a first alert for the wearer of the helmet 110 (step S904). Next, the safe driving support device 101 resets the timer (step S905). Then, the safe driving support device 101 determines whether to end the execution of the safe driving support process (step S906).

  Here, when the execution of the safe driving support process is not finished (step S906: No), the safe driving support device 101 proceeds to step S801 shown in FIG. On the other hand, when the execution of the safe driving support process is ended (step S906: Yes), the safe driving support device 101 ends the series of processes according to this flowchart.

  The safe driving support device 101 determines that the execution of the safe driving support processing is to be ended, for example, in response to the reception of the end instruction of the safe driving support processing by the input device (not shown).

  Further, in step S901, when the inclination to the direction in which the turn indicator is turned on is not canceled (step S901: No), the safe driving support device 101 turns on the turn indicator in step S805 shown in FIG. It is determined whether or not a predetermined time t has elapsed since the inclination in the direction is detected (step S 907). The fixed time t is about 5 seconds.

  Here, when the predetermined time t has not elapsed (step S 907: No), the safe driving support device 101 returns to step S 901. On the other hand, when the fixed time t has elapsed (step S 907: Yes), the safe driving support device 101 determines whether the direction indicator of the motorcycle BK is on (step S 908).

  Here, when the turn indicator is not lighted (step S908: No), the safe driving support device 101 proceeds to step S905. On the other hand, when the turn indicator is on (step S 908: Yes), the safe driving support device 101 outputs a first alert for the wearer of the helmet 110 (step S 909). This can, for example, alert a driver who has forgotten to release the turn signal while traveling on a long curve. Then, the safe driving support device 101 proceeds to step S905.

  When it is determined in step S902 that the motorcycle BK is traveling and the direction indicator of the motorcycle BK is not on (step S902: No), the safe driving support device 101 proceeds to step S905. Transition. At this time, the safe driving support device 101 records the elapsed time x measured by the timer in the memory 202. The elapsed time x is used, for example, to determine the predetermined time T.

  Thereby, when the wearer of the helmet 110 forgets to release the direction indicator, it is possible to call attention to forgetting to release the direction indicator. Moreover, when the wearer of the helmet 110 puts out a turn indicator incorrectly, confirmation of the indication direction can be prompted.

  As described above, according to the safe driving support device 101 according to the embodiment, the direction indicator of the running motorcycle BK is lit based on the captured image captured by the camera 102 mounted on the helmet 110. It can be determined whether or not. Further, according to the safe driving support device 101, when it is determined that the turn signal has been turned on, based on the data regarding the movement detected by the sensor 103 mounted on the helmet 110, the turn signal is turned on. It can be determined whether a turn or turn has been completed. Then, according to the safe driving support device 101, when it is determined that the right or left turn or the course change has been completed, whether or not the direction indicator of the motorcycle BK is lit based on the captured image captured by the camera 102 If determined and it is determined that the turn indicator is on, a first alert for the wearer of the helmet 110 can be output.

  As a result, although the turning or turning of the bike BK in the direction in which the turn indicator has been turned on is completed, the direction indication to the wearer of the helmet 110 is maintained when the turn indicator remains on. You can call attention to forgetting to release the vessel. As a result, the wearer of the helmet 110 can notice early that he has forgotten to release the direction indicator.

  Further, according to the safe driving support device 101, after judging that the left / right turn or course change in the direction in which the turn indicator is lit is completed, it is determined that the turn indicator is lit, and the motorcycle BK When it is determined that the vehicle is traveling, the first alert can be output. As a result, when the wearer of the helmet 110 intentionally stops at the shoulder of the road while giving a direction indication or pauses according to a road sign, etc., a warning is given that warns of forgetting to release the direction indicator. It can prevent.

  Further, according to the safe driving support device 101, when it is determined that the direction indicator is on continuously for a predetermined time T after it is determined that the direction indicator on the motorcycle BK is on, the first alert is given. It can be output. As a result, even if the turn indicator remains on after turning or turning in the direction in which the turn indicator on the bike BK is lit, the predetermined time T has elapsed since the turn indicator has been turned on. It is possible not to output the first alert until it has elapsed. As a result, for example, it is possible to prevent excessive alerting to the driver who tends not to release the turn indicator immediately after turning or turning.

  Further, according to the safe driving support device 101, after it is determined that the direction indicator of the motorcycle BK has been lit, an elapsed time x from when it is determined that the direction indicator is not lit is stored in the memory 202. The predetermined time T can be determined based on the elapsed time x accumulated in 202. However, after the first alert is output, the elapsed time x when it is determined that the turn indicator is not lit is excluded.

  As a result, the predetermined time T can be determined from the actual elapsed time x from when the wearer of the helmet 110 activates the turn indicator to when the direction indicator is released without warning. As a result, the output timing of the first alert can be adjusted in consideration of the usual release timing of the turn signal by the wearer of the helmet 110.

  Further, according to the safe driving support device 101, an alert sound or an alert message can be output from the speaker 104 mounted on the helmet 110 as a first alert. This makes it possible to warn of the forgetting of the release of the turn signal through the hearing of the wearer of the helmet 110.

  Further, according to the safe driving support device 101, the LED light 105 mounted on the helmet 110 can be turned on as a first alert. Thereby, it is possible to warn the user of the helmet 110 of the forgetting to release the direction indicator through the vision of the wearer. In addition, even in a situation where it is difficult to hear the sound due to the noise, it is possible to give an effective warning that the wearer of the helmet 110 can easily notice.

  Further, according to the safe driving support device 101, the vibrator 106 mounted on the helmet 110 can be vibrated as a first alert. This makes it possible to warn of the forgetting of the release of the turn signal through the touch of the wearer of the helmet 110. In addition, even in a situation where it is difficult to hear the sound due to the noise, it is possible to give an effective warning that the wearer of the helmet 110 can easily notice.

  Further, according to the safe driving support device 101, when the inclination in the direction opposite to the direction in which the turn indicator is lit is detected based on the data on the inclination detected by the inclination sensor 204, the indication direction by the turn indicator Can output a second alert prompting confirmation of the This makes it possible for the wearer of the helmet 110 to notice an early turnout error.

  From these things, according to the safe driving support device 101 and the helmet 110 according to the embodiment, it is possible to prevent the forgetting of release of the turn signal by the wearer of the helmet 110 and to support the safe driving. Also, by mounting the safe driving support device 101 on the helmet 110, the helmet 110 can be used without relying on a specific bike BK. For this reason, the convenience at the time of sharing the helmet 110 by the person who owns two or more bikes BK, or two or more people can be improved.

  The safe driving support method described in the present embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. The safe driving support program is a computer-readable recording medium such as a hard disk, a flexible disk, a CD (Compact Disc) -ROM, a MO (Magneto-Optical disk), a DVD (Digital Versatile Disk), and a USB (Universal Serial Bus) memory. It is recorded on a medium and executed by being read from the recording medium by a computer. Further, the present safe driving support program may be distributed via a network such as the Internet.

  The following appendices will be further disclosed regarding the embodiment described above.

(Supplementary Note 1) Based on a captured image captured by a camera mounted on a helmet, it is determined whether or not the turn indicator of a running vehicle has been lit,
If it is determined that the turn signal has been turned on, based on the data on the movement detected by the sensor mounted on the helmet, it is determined whether a turn or turn to the direction in which the turn signal is turned on has been completed. To determine
If it is determined that the left or right turn or route change in the direction is completed, it is determined whether the direction indicator is on the basis of a captured image captured by the camera,
Outputting an alert for the wearer of the helmet when it is determined that the turn indicator is on;
A safe driving support device comprising a control unit.

(Supplementary Note 2) The control unit
The alert is output when it is determined that the turn indicator is on and it is determined that the vehicle is traveling after it is determined that a turn or turn to the direction has been completed. The safe driving support device according to claim 1, characterized in that.

(Supplementary Note 3) The control unit
The alert is output when it is determined that the direction indicator is on continuously for a predetermined time after it is determined that the direction indicator is on, the alert is output. Safe driving support device.

(Supplementary Note 4) The control unit
An elapsed time until it is determined that the turn indicator has not been lit since it is determined that the turn indicator has been lit is stored in the storage unit.
The predetermined time is determined based on the storage content of the storage unit.
Appendix 3. The safe driving support device according to appendix 3.

(Supplementary Note 5) The control unit
The safe driving support device according to any one of appendices 1 to 4, wherein as the alert, an alert sound or an alert message is output from a speaker mounted on the helmet.

(Supplementary Note 6) The control unit
The safe driving support device according to any one of appendices 1 to 5, wherein a light mounted on the helmet is turned on as the alert.

(Supplementary Note 7) The control unit
The safe driving support device according to any one of appendices 1 to 6, wherein a vibrator mounted on the helmet is vibrated as the alert.

(Supplementary Note 8) The sensor includes a sensor that measures acceleration,
The control unit
It is judged whether the said vehicle is drive | working based on the data regarding the acceleration measured by the said sensor, The safe driving assistance apparatus as described in any one of the additional notes 1-7 characterized by the above-mentioned.

(Supplementary Note 9) The control unit
It is judged whether the said vehicle is drive | working based on the captured image imaged with the said camera, The safe driving assistance apparatus as described in any one of the additional notes 1-8 characterized by the above-mentioned.

(Supplementary note 10) The sensor includes a sensor that detects data on tilt.
The control unit
If it is determined that the direction indicator has been turned on, it is determined whether or not the inclination to the direction in which the direction indicator is turned on is detected based on data on the inclination detected by the sensor.
When the inclination in the direction in which the direction indicator is lit is detected, it is determined whether the inclination has been eliminated based on data on the inclination detected by the sensor.
If it is determined that the inclination has been eliminated, it is determined that a turn or turn in the direction has been completed.
The safe driving support device according to any one of appendices 1 to 9, characterized in that

(Supplementary Note 11) The control unit
Outputting an alert for prompting confirmation of the indication direction by the direction indicator, when the inclination in the direction opposite to the direction in which the direction indicator is lit is detected based on data on the inclination detected by the sensor; Appendix 10. The safe driving support device according to appendix 10.

(Supplementary note 12) The safe driving support device according to any one of supplementary notes 1 to 11, wherein the vehicle is a motorcycle.

(Supplementary note 13) The safe driving support device according to any one of supplementary notes 1 to 12, which is mounted on the helmet.

(Supplementary Note 14) A helmet worn by a driver of a vehicle
A camera capable of imaging a range including a display light indicating an operating state of a direction indicator of the vehicle when a wearer of the helmet drives the vehicle;
A sensor that detects motion data;
Based on the captured image captured by the camera, it is determined whether or not the turn signal of the traveling vehicle is turned on, and if it is determined that the turn signal is turned on, the movement detected by the sensor Based on the data on the direction, it is determined whether the turn or turn in the direction in which the turn indicator is lit is completed, and it is determined that the turn or turn in the direction is completed, the camera Based on the image captured by the camera, it is determined whether or not the turn signal is on, and when it is determined that the turn signal is on, an alert for the wearer of the helmet is output. Safe driving support device,
A helmet characterized by having.

101 Safety Driving Support Device 102 Camera 103 Sensor 104 Speaker 105 LED Light 106 Vibrator 110 Helmet 200 Bus 201 CPU
202 Memory 203 Acceleration Sensor 204 Inclination Sensor 300, 611 to 614, 621 to 642 Captured Image 301, 302 Indicator Light 303 Speedometer 304 Tachometer 400 Meter Panel Image DB
401 meter panel image information 501 acquisition unit 502 first monitoring unit 503 second monitoring unit 504 determination unit 505 output unit 700 speedometer image

Claims (8)

Based on the captured image captured by the camera mounted on the helmet, it is determined whether the turn indicator of the running vehicle has been lit,
If it is determined that the turn signal has been turned on, based on the data on the movement detected by the sensor mounted on the helmet, it is determined whether a turn or turn to the direction in which the turn signal is turned on has been completed. To determine
If it is determined that the left or right turn or route change in the direction is completed, it is determined whether the direction indicator is on the basis of a captured image captured by the camera,
Outputting an alert for the wearer of the helmet when it is determined that the turn indicator is on;
A safe driving support device comprising a control unit. The control unit
The alert is output when it is determined that the turn indicator is on and it is determined that the vehicle is traveling after it is determined that a turn or turn to the direction has been completed. The safe driving support device according to claim 1, characterized in that. The control unit
The alert is output when it is determined that the turn indicator is on continuously for a predetermined time after it is determined that the turn indicator has been turned on. Safe driving support device described. The control unit
An elapsed time until it is determined that the turn indicator has not been lit since it is determined that the turn indicator has been lit is stored in the storage unit.
The predetermined time is determined based on the storage content of the storage unit.
The safe driving support device according to claim 3, The control unit
The safe driving support device according to any one of claims 1 to 4, wherein an alert sound or an alert message is output as the alert from a speaker mounted on the helmet. The control unit
The safe driving support device according to any one of claims 1 to 5, wherein a light mounted on the helmet is turned on as the alert. The control unit
The safe driving support device according to any one of claims 1 to 6, wherein a vibrator mounted on the helmet is vibrated as the alert. A helmet worn by the driver of the vehicle,
A camera capable of imaging a range including a display light indicating an operating state of a direction indicator of the vehicle when a wearer of the helmet drives the vehicle;
A sensor that detects motion data;
Based on the captured image captured by the camera, it is determined whether or not the turn signal of the traveling vehicle is turned on, and if it is determined that the turn signal is turned on, the movement detected by the sensor Based on the data on the direction, it is determined whether the turn or turn in the direction in which the turn indicator is lit is completed, and it is determined that the turn or turn in the direction is completed, the camera Based on the image captured by the camera, it is determined whether or not the turn signal is on, and when it is determined that the turn signal is on, an alert for the wearer of the helmet is output. Safe driving support device,
A helmet characterized by having.

Images