JP6918271B2 - Information record control device and information record control method - Google Patents

Description

The present invention relates to an information recording control device and an information recording control method that control recording information about another vehicle that affects the traveling of the own vehicle.

Conventionally, when it is determined that a vehicle accident has occurred by detecting a sudden physical change of the vehicle using an impact sensor or the like provided on the vehicle, an image of the outside of the vehicle during a certain period of time before and after the accident occurs, etc. A technique for recording information is disclosed (see, for example, Patent Document 1). According to the technique described in Patent Document 1, it is highly convenient because the situation outside the vehicle and the vehicle information at the time of the accident can be verified after the accident occurs.

Japanese Unexamined Patent Publication No. 2003-69936

In recent years, driving behavior such as tilting driving, which has not caused an accident but affects the driving of a vehicle, has become a social problem, and there is an increasing demand for recording the driving behavior. However, such a traveling action cannot be recorded by the technique described in Patent Document 1 because physical contact between vehicles does not occur.

On the other hand, in order to record a driving action such as a tilting driving, a method of performing a manual operation such as pressing a switch instructing the start of recording is conceivable, but the driver of the vehicle receiving such a driving action performs the operation. Things are not easy psychologically and physically.

In addition, a method of detecting a vehicle that performs a driving act such as a tilting operation by using a sensor provided in the vehicle that detects the surrounding condition of the vehicle can be considered. Difficult to decide. Specifically, if the criteria for judgment are loosened, there is a problem that the recording capacity will be exceeded immediately after being recorded frequently. There is a problem that it is not recorded even though it is recognized as.

The present invention has been made to solve such a problem, and provides an information recording control device and an information recording control method capable of reliably recording information about a vehicle traveling such as a road rage. The purpose is.

In order to solve the above problems, the information recording control device according to the present invention includes a caution vehicle detection unit that detects another vehicle that exists in the vicinity of the own vehicle and affects the running of the own vehicle as a caution vehicle, and a self. The attention moving body recognition unit that recognizes the attention moving body that is the moving body that the driver of the vehicle is paying attention to, the attention moving body recognized by the attention moving body recognition unit, and the attention vehicle detected by the attention vehicle detection unit. When they are the same, it includes a control unit that controls to record information about the caution vehicle as caution vehicle information.

According to the present invention, when the attention moving object recognized by the attention moving object recognition unit and the attention vehicle detected by the attention vehicle detection unit are the same, the information recording control device records information about the attention vehicle as caution vehicle information. Since the control is performed, it is possible to reliably record information about a vehicle that is traveling such as a tilting operation.

Objectives, features, aspects, and advantages of the present invention will be made more apparent with the following detailed description and accompanying drawings.

It is a block diagram which shows an example of the structure of the information recording control apparatus according to Embodiment 1 of this invention. It is a block diagram which shows an example of the structure of the information recording control apparatus according to Embodiment 1 of this invention. It is a figure for demonstrating the detection of the caution vehicle by Embodiment 1 of this invention. It is a figure for demonstrating the line-of-sight direction of a driver according to Embodiment 1 of this invention. It is a figure for demonstrating the determination of attention of a driver by Embodiment 1 of this invention. It is a figure which shows an example of the recording area of the recording apparatus according to Embodiment 1 of this invention. It is a flowchart which shows an example of the operation of the information recording control apparatus according to Embodiment 1 of this invention. It is a figure for demonstrating the attention of the driver by Embodiment 1 of this invention. It is a figure for demonstrating the attention of the driver by Embodiment 1 of this invention. It is a figure which shows an example of the internal structure of the own vehicle according to Embodiment 1 of this invention. It is a figure which shows an example of the display of the electronic mirror by Embodiment 1 of this invention. It is a flowchart which shows an example of the operation of the information recording control apparatus according to Embodiment 1 of this invention. It is a figure which shows an example of the display of HUD by Embodiment 1 of this invention. It is a figure which shows an example of the display of HUD by Embodiment 1 of this invention. It is a block diagram which shows an example of the structure of the information recording control apparatus according to Embodiment 2 of this invention. It is a flowchart which shows an example of the operation of the information recording control apparatus by Embodiment 2 of this invention. It is a block diagram which shows an example of the structure of the information recording control apparatus according to Embodiment 2 of this invention. It is a block diagram which shows an example of the structure of the information recording control apparatus according to Embodiment 3 of this invention. It is a flowchart which shows an example of the operation of the information recording control apparatus according to Embodiment 3 of this invention. It is a block diagram which shows an example of the structure of the information recording control apparatus according to Embodiment 4 of this invention. It is a flowchart which shows an example of the operation of the information recording control apparatus according to Embodiment 4 of this invention. It is a flowchart which shows an example of the operation of the information recording control apparatus according to Embodiment 4 of this invention. It is a figure which shows an example of the display of HUD by Embodiment 4 of this invention. It is a figure which shows an example of the display of HUD by Embodiment 4 of this invention. It is a figure which shows an example of the display of the electronic mirror by Embodiment 4 of this invention. It is a block diagram which shows an example of the hardware composition of the information recording control apparatus by embodiment of this invention. It is a block diagram which shows an example of the hardware composition of the information recording control apparatus by embodiment of this invention. It is a block diagram which shows an example of the structure of the information recording control system by embodiment of this invention.

Embodiments of the present invention will be described below with reference to the drawings.

<Embodiment 1>
<1-1. Configuration>
FIG. 1 is a block diagram showing an example of the configuration of the information recording control device 1 according to the first embodiment. Note that FIG. 1 shows the minimum necessary configuration for configuring the information recording control device according to the first embodiment.

As shown in FIG. 1, the information recording control device 1 includes a caution vehicle detection unit 2, a attention moving object recognition unit 3, and a control unit 4.

The caution vehicle detection unit 2 detects another vehicle that exists in the vicinity of the own vehicle and affects the running of the own vehicle as a caution vehicle. The attention moving body recognition unit 3 recognizes the attention moving body which is the moving body that the driver of the own vehicle is paying attention to. When the attention moving object recognized by the attention moving object recognition unit 3 and the attention vehicle detected by the attention vehicle detection unit 2 are the same, the control unit 4 controls to record the information about the attention vehicle as the attention vehicle information. ..

Next, another configuration of the information recording control device including the information recording control device 1 shown in FIG. 1 will be described.

FIG. 2 is a block diagram showing an example of the configuration of the information recording control device 5 according to another configuration.

As shown in FIG. 2, the information recording control device 5 includes a caution vehicle detection unit 2, a attention moving object recognition unit 3, and a control unit 4. Further, the caution vehicle detection unit 2 is connected to the peripheral situation detection device 6, the attention moving object recognition unit 3 is connected to the peripheral situation detection device 6 and the line-of-sight detection device 7, and the control unit 4 is connected to the recording device 8. .. The peripheral condition detection device 6 is connected to a camera 9, a millimeter wave radar 10, an ultrasonic sensor 11, and a laser radar 12. The information recording control device 5, the peripheral situation detection device 6, the line-of-sight detection device 7, the recording device 8, the camera 9, the millimeter wave radar 10, the ultrasonic sensor 11, and the laser radar 12 are provided in the own vehicle. And.

The caution vehicle detection unit 2 detects other vehicles existing in the vicinity of the own vehicle and affecting the running of the own vehicle as caution vehicles based on the peripheral information acquired from the peripheral situation detection device 6. When the caution vehicle detection unit 2 detects the caution vehicle, the caution vehicle detection unit 2 outputs the detection result to the control unit 4. The detection result includes at least the relative position of the caution vehicle with respect to the own vehicle.

Based on the results detected by each of the millimeter-wave radar 10, the ultrasonic sensor 11, and the laser radar 12, the peripheral situation detection device 6 is located at the relative position of another vehicle existing in the vicinity of the own vehicle and in the vicinity of the own vehicle. The positional relationship between the existing other vehicle and the lane is detected, and this information is output as peripheral information to the caution vehicle detection unit 2 and the attention moving object recognition unit 3. In this way, the peripheral information includes the relative positions of other vehicles existing in the vicinity of the own vehicle. The relative position is the relative position of the other vehicle with respect to the own vehicle. Peripheral information may include the positional relationship between the lane and other vehicles existing in the vicinity of the own vehicle. Further, the peripheral situation detection device 6 outputs the image captured by the camera 9 to the recording device 8. A plurality of cameras 9 may be provided for photographing the periphery of the own vehicle.

Here, the detection of the caution vehicle by the caution vehicle detection unit 2 will be described.

FIG. 3 is a diagram for explaining the detection of the caution vehicle by the caution vehicle detection unit 2. FIG. 3 shows an example of the traveling behavior of the other vehicle 14 that affects the traveling of the own vehicle 13. The broken line arrow in FIG. 3 indicates a change over time in the relative position of the other vehicle 14 with respect to the own vehicle 13.

The traveling behavior of the other vehicle 14 that affects the traveling of the own vehicle 13 includes, for example, the act of the other vehicle 14 suddenly approaching the own vehicle 13, the act of the other vehicle 14 suddenly braking immediately before the own vehicle 13, and the like. The act of the vehicle 14 catching up with the own vehicle 13, the act of the other vehicle 14 pulling the width toward the own vehicle 13, the act of the other vehicle 14 sounding a crush against the own vehicle 13, and the act of the other vehicle 14 passing with respect to the own vehicle 13. The act of repeating at least one of the act of swearing and the act of the driver of the other vehicle 14 swearing at the driver of the own vehicle 13 for a predetermined time such as 5 minutes or more. To say. The caution vehicle detection unit 2 detects another vehicle 14 that has performed such a traveling act as a caution vehicle.

It should be noted that the act of approaching suddenly, the act of suddenly braking, the act of catching up, and the act of pulling the width as described above can be determined based on the change over time in the relative position of the other vehicle 14 with respect to the own vehicle 13. can. The act of passing can be determined by image processing the image acquired from the camera 9. In this case, the peripheral situation detection device 6 includes the result of image processing of the image acquired from the camera 9 in the peripheral information and outputs it to the caution vehicle detection unit 2. In addition, the act of honking the horn and the act of swearing can be determined based on the voice acquired by a microphone (not shown). In this case, the microphone is provided in the vehicle, and the peripheral situation detection device 6 includes the sound acquired from the microphone in the peripheral information and outputs it to the caution vehicle detection unit 2.

Note that the caution vehicle may be detected by weighting the traveling behavior described above. For example, regarding the act of suddenly approaching, the caution vehicle detection unit 2 may detect the other vehicle 14 as a caution vehicle when the other vehicle 14 repeats the act of approaching the own vehicle 13 up to 2 m for 3 minutes. When the other vehicle 14 repeats the act of approaching the own vehicle 13 up to 1 m for 1 minute, the other vehicle 14 may be detected as a caution vehicle.

Returning to the explanation of FIG. 2, the attention moving object recognition unit 3 of the own vehicle is based on the line-of-sight information of the driver of the own vehicle acquired from the line-of-sight detection device 7 and the peripheral information acquired from the peripheral situation detection device 6. Recognize the moving object of interest, which is the moving object that the driver is paying attention to. When the driver of the own vehicle recognizes that he / she is paying attention to the moving object of interest, the moving object recognition unit 3 outputs the recognition result to the control unit 4. The recognition result includes at least the relative position of the moving object of interest with respect to the own vehicle.

The line-of-sight detection device 7 has, for example, a camera, and detects the line-of-sight direction of the driver by performing image processing on the eyes of the driver of the own vehicle photographed by the camera. The line-of-sight detection device 7 may detect the line-of-sight direction of the driver of the own vehicle by using a sensor other than the camera. The line-of-sight detection device 7 outputs the detected line-of-sight direction of the driver of the own vehicle as line-of-sight information to the attention moving body recognition unit 3.

Here, the recognition of the moving body of interest by the moving body of interest recognition unit 3 will be described.

FIG. 4 is a diagram for explaining the line-of-sight direction of the driver.

As shown in FIG. 4, the attention moving body recognition unit 3 sets the central direction of the moving body 15 as seen from the driver 16 of the own vehicle as Θ0, and the line-of-sight direction Θ of the driver 16 satisfies Θ2 ≧ Θ> Θ1. At this time, it is determined that the line-of-sight direction Θ of the driver 16 coincides with the moving body 15. Here, the left side is positive and the right side is negative with respect to the central direction Θ0 of the moving body 15.

In FIG. 4, for example, Θ2 = Θ0 + ΔΘ2, Θ1 = Θ0−ΔΘ1, and ΔΘ2 = ΔΘ1 = 5 degrees. Note that ΔΘ2 ≠ ΔΘ1 may be used. In this case, the driver is more difficult to see as the vehicle deviates from the traveling direction of the own vehicle. Therefore, when the central direction Θ0 of the moving body 15 is on the right side of the front of the driver 16, ΔΘ1> ΔΘ2 is set and the central direction of the moving body 15 is set. When Θ0 is on the left side with respect to the front of the driver 16, ΔΘ2> ΔΘ1 may be set.

FIG. 5 is a diagram for explaining a judgment of attention of the driver. In FIG. 5, the horizontal axis represents time and the vertical axis represents line-of-sight coincidence. The line-of-sight coincidence degree indicates whether or not the line-of-sight direction Θ of the driver 16 described above coincides with the moving body 15. When the line-of-sight direction Θ of the driver 16 coincides with the moving body 15, the line-of-sight coincidence degree is “1”. On the other hand, when the line-of-sight direction Θ of the driver 16 does not match the moving body 15, the line-of-sight coincidence degree is “0”.

In the example of FIG. 5, when the line-of-sight direction Θ of the driver 16 coincides with the moving body 15 for a total of 1 minute or more in 5 minutes from t1 to t2, the driver 16 moves in the attention moving body recognition unit 3. It is judged that the attention was paid to the body 15.

Returning to the explanation of FIG. 2, when the attention moving object recognized by the attention moving object recognition unit 3 and the attention vehicle detected by the attention vehicle detection unit 2 are the same, the control unit 4 gives information about the attention vehicle to the attention vehicle. The recording device 8 is controlled so as to record as information. That is, when the attention moving object recognized by the attention moving object recognition unit 3 and the attention vehicle detected by the attention vehicle detection unit 2 are the same, the control unit 4 says that the driver of the own vehicle pays attention to the attention vehicle. The recording device 8 is controlled so as to determine and record the information about the caution vehicle as the caution vehicle information. Specifically, the control unit 4 is based on the relative position of the attention moving object with respect to the own vehicle acquired from the attention moving object recognition unit 3 and the relative position of the attention vehicle with respect to the own vehicle acquired from the attention vehicle detection unit 2. When it is determined that the moving object of interest and the attention vehicle are the same, the recording device 8 is controlled so as to record the attention vehicle information.

For example, the control unit 4 controls the recording device 8 so that the caution vehicle detection unit 2 records a fixed time image centered on the time when the caution vehicle is detected as the caution vehicle.

The recording device 8 constantly records the video acquired from the peripheral situation detection device 6. Further, the recording device 8 protects and records the caution vehicle information according to the instruction from the control unit 4. A protected record is a record in which an image cannot be erased without a predetermined operation or a predetermined rule described later. The recording device 8 is also referred to as a drive recorder or a data recorder.

FIG. 6 is a diagram showing an example of a recording area of the recording device 8.

As shown in FIG. 6, the recording device 8 includes a constant recording area 17 that constantly records an image acquired from the surrounding situation detection device 6, and a protective recording area 18 that protects and records caution vehicle information according to an instruction from the control unit 4. It has an event recording area 19 for the protection recording area 18 and an event recording area 20 for the constant recording area 17. In the example of FIG. 5, the constant recording area 17 and the protected recording area 18 record a video with the recording for 6 minutes as one block. “LMn” and “LMm” in FIG. 6 indicate one block.

The constant recording area 17 always records video after the recording device 8 is activated. In the example of FIG. 6, the constant recording area 17 has a recording capacity of 240 blocks, and 24 hours of video is recorded in block units. When the video recording is started for the first time, the video is recorded in the order of "LM1" and "LM2", and after recording the video on "LM240", it returns to "LM1" and the video recorded on "LM1" is recorded. Overwrite. When the power of the recording device 8 is turned off, the block in which the video was recorded last may be stored, and when the recording of the video is resumed, the video may be recorded from the block following the previous one.

The protected recording area 18 has a recording capacity of, for example, 10 blocks, and records one hour's worth of video in block units. The video recorded in the protected recording area 18 can be erased only by a predetermined operation or a predetermined rule, and the recorded video as in the constant recording area 17 is not overwritten. Recording an image in the protected recording area 18 in this way is called a protected recording. Predetermined operations include, for example, button operations (not shown). Further, as a predetermined rule, for example, overwriting of a video one month after recording is allowed. As will be described later, when the control unit 4 gives an instruction to protect and record the caution vehicle information, the video recorded in the constant recording area 17 is transferred to the protection recording area 18 as the caution vehicle information.

The event recording area 19 records a pointer indicating the position of each block recorded in the protection recording area 18 and additional information. The additional information is recorded in the event recording area 19 as caution vehicle information. The additional information includes, for example, the time when the video was recorded in the protected recording area 18 and the vehicle profile. The vehicle profile is included in the peripheral information detected by the peripheral condition detection device 6, and includes the vehicle number, vehicle type, body color, and the like of the caution vehicle.

The event recording area 20 records a pointer indicating the position of each block recorded in the constant recording area 17.

The configuration of the recording area of the recording device 8 is not limited to the configuration shown in FIG. 6, and may be subdivided. The recording time in the recording device 8, the recording capacity in block units, and the role of each recording area are not limited to the above description. Further, the recording device 8 may be provided outside the own vehicle.

<1-2. Operation>
FIG. 7 is a flowchart showing an example of the operation of the information recording control device 5.

In step S11, the caution vehicle detection unit 2 acquires peripheral information from the peripheral situation detection device 6. As described above, since the peripheral information includes the relative position of the other vehicle existing around the own vehicle, the behavior of the other vehicle can be known from the change of the relative position with time.

In step S12, the attention moving body recognition unit 3 recognizes the attention moving body, which is the moving body that the driver of the own vehicle is paying attention to, based on the line-of-sight information acquired from the line-of-sight detection device 7.

In step S13, the caution vehicle detection unit 2 determines whether or not the caution vehicle has been detected based on the peripheral information. If a caution vehicle is detected, the process proceeds to step S14. On the other hand, if the caution vehicle is not detected, the process returns to step S11.

In step S14, the control unit 4 determines whether or not the driver of the own vehicle has paid attention to the caution vehicle. Specifically, the control unit 4 is based on the relative position of the attention moving object with respect to the own vehicle acquired from the attention moving object recognition unit 3 and the relative position of the attention vehicle with respect to the own vehicle acquired from the attention vehicle detection unit 2. Determine if the moving object of interest and the vehicle of interest are the same. If the moving object of interest and the attention vehicle are the same, it is determined that the driver of the own vehicle has paid attention to the attention vehicle, and the process proceeds to step S15. On the other hand, if the moving object of interest and the attention vehicle are not the same, it is determined that the driver of the own vehicle did not pay attention to the attention vehicle, and the process returns to step S11.

In step S15, the control unit 4 controls the recording device 8 so as to protect and record the caution vehicle information. When the control unit 4 gives an instruction to protect and record the caution vehicle information, the recording device 8 uses the image recorded in the constant recording area 17 as the caution vehicle information in the protection recording area 18 as shown in FIG. Forward. Further, when the caution vehicle information includes additional information, the recording device 8 records the additional information in the event recording area 19. As a result, the caution vehicle information is protected and recorded in the recording device 8.

<1-3. Modification 1>
In the above, the case where the moving body recognition unit 3 of interest determines that the line-of-sight direction Θ of the driver of the own vehicle matches the moving body when the line-of-sight direction Θ of the driver satisfies Θ2 ≧ Θ> Θ1 has been described. .. In this case, the degree of line-of-sight coincidence when the driver's line-of-sight direction Θ coincides with the moving body has been described as “1”, but the present invention is not limited to this. For example, as shown in FIGS. 8 and 9, a function may be used in which the degree of line-of-sight coincidence decreases as the line-of-sight direction Θ of the driver 22 deviates from the central direction Θ0 of the moving body 21.

In the examples of FIGS. 8 and 9, the degree of line-of-sight coincidence when the line-of-sight direction Θ of the driver 22 satisfies Θ2 ≧ Θ ≧ Θ1 is “1”. Further, when the line-of-sight direction Θ of the driver 22 satisfies Θ4> Θ> Θ2 or Θ1> Θ> Θ3, the line-of-sight coincidence degree is “between 0 and 1”. For example, when the time of the line-of-sight coincidence "0.5" was 2 minutes in total in the 5 minutes from t1 to t2 in FIG. 5 described above, the time of the line-of-sight coincidence "1" was 1 minute in total. Treat as when. Then, when the line-of-sight direction Θ of the driver 22 coincides with the moving body 21 for a total of 1 minute or more in 5 minutes from t1 to t2, the attention moving body recognition unit 3 pays attention to the moving body 21 by the driver 22. Judge that it was done.

It should be noted that the function is not limited to the line-of-sight coincidence function shown in FIG. 9, and may be a curved or discontinuous function.

The longer the driver's line-of-sight direction Θ coincides with the moving body, the higher the line-of-sight coincidence may be. For example, when the driver's line-of-sight direction Θ coincides with the moving body continuously for 0.5 seconds or more, the line-of-sight coincidence may be increased by 1.5 times. In this case, if the driver's line-of-sight direction Θ coincides with the moving body continuously for 1 second, the driver's line-of-sight direction Θ may coincide with the moving body continuously for 1.5 seconds.

When the attention moving body recognition unit 3 detects stress based on the facial expression of the driver of the own vehicle, the attention moving body recognition unit 3 may lower the criterion for determining whether or not the moving body is paying attention. Facial expressions of the driver include, for example, steepness, fear, or irritation. Such a driver's facial expression can be determined based on the line-of-sight information acquired from the line-of-sight detection device 7 or the information obtained by image-recognizing the entire face including the driver's line of sight. For example, when the attention moving body recognition unit 3 does not detect the stress of the driver of the own vehicle, when the driver's line-of-sight direction Θ coincides with the moving body in a total of 1 minute or more in 5 minutes. When it is judged that the driver is paying attention to the moving body and the stress of the driver of the own vehicle is detected, when the driver's line-of-sight direction Θ coincides with the moving body in a total of 45 seconds or more in 5 minutes. It may be determined that the driver is paying attention to the moving object.

In addition to the facial expression of the driver of the own vehicle described above, the physiological information of the driver may be further considered to determine the criteria for determining whether or not the moving body is being focused on. Examples of the driver's physiological information include the driver's heartbeat measured by a sensor provided on the steering wheel, information detected by a biosensor attached to the driver, and the like.

<1-4. Modification 2>
In the above, the case where the driver of the own vehicle directly looks at the moving object has been described, but the present invention is not limited to this. For example, when the driver is looking at a moving object reflected in the rearview mirror, the driver's line-of-sight direction is based on the driver's line-of-sight direction with respect to the rearview mirror and the position and orientation of the rearview mirror. May be determined whether or not matches the moving object. That is, the attention moving body recognition unit 3 pays attention when the line of sight of the driver of the own vehicle is within a predetermined range centered on the direction in which the moving body exists in the rearview mirror provided in the own vehicle. It is judged that the moving object has been recognized. In the own vehicle as shown in FIG. 10, each of the rearview mirror 23, the right side mirror 24, and the left side mirror 25 corresponds to a rearview mirror.

When the own vehicle is equipped with an electronic mirror system, the display device 26 displays an image of the rear of the own vehicle. In this case, it may be determined whether or not the line-of-sight direction of the driver matches the moving body based on the line-of-sight direction of the driver with respect to the display device 26. That is, when the moving object recognition unit 3 of interest has the line of sight of the driver of the own vehicle within a predetermined range centered on the direction in which the moving object exists in the display of the electronic mirror provided on the own vehicle. It is judged that the moving object of interest has been recognized.

For example, as shown in FIG. 11, the display device 26 has display areas 27 and 28, an image of the right rear side of the own vehicle 29 is displayed in the display area 27, and the own vehicle is displayed in the display area 28. The image on the left rear side of 29 is displayed. In the example of FIG. 11, the attention moving body recognition unit 3 recognizes that the moving body 30 is the attention moving body when the line-of-sight direction of the driver coincides with the moving body 30 displayed in the display area 27. ..

<1-5. Modification 3>
In the above, the case where the driver of the own vehicle starts recording the caution vehicle information when paying attention to the caution vehicle has been described. At this time, various information indicating the state of the information recording control device 5 is notified to the driver. You may.

FIG. 12 is a flowchart showing an example of the operation of the information recording control device 5 according to the modification 3. Note that steps S21 to S23 in FIG. 12 correspond to steps S11 to S13 in FIG. 7, step S25 in FIG. 12 corresponds to step S14 in FIG. 7, and step S27 in FIG. 12 corresponds to step S15 in FIG. Since it is supported, the description is omitted here. In the following, step S24 and step S26 will be described.

In step S24, the control unit 4 controls to notify that the caution vehicle detection unit 2 has detected the caution vehicle. For example, as shown in FIG. 13, the control unit 4 controls a HUD (Head Up Display) (not shown) so as to display the attention guidance object 32 in the vicinity of the attention vehicle 31. As a result, the attention guidance object 32 is displayed on the HUD. By displaying the attention guidance object 32 on the HUD, it is possible to notify the driver that the attention vehicle has been detected and guide the driver's line of sight to the attention vehicle.

In step S26, the control unit 4 controls to notify that the protection recording of the caution vehicle information has started. For example, as shown in FIG. 14, the control unit 4 controls the HUD to display the protection record start object 34 indicating that the protection recording of the caution vehicle information regarding the caution vehicle 33 has been started. As a result, the protection recording start object 34 is displayed on the HUD. By displaying the protection recording start object 34 on the HUD, the driver can know that the protection recording of the caution vehicle information has started.

In addition, in FIG. 12, either process of step S24 or step S26 may be performed.

The attention guidance object 32 shown in FIG. 13 and the protection recording start object shown in FIG. 14 may be displayed in the display areas 27 and 28 in the electronic mirror system as shown in FIG. 11, for example.

In the above steps S24 and S26, the case where the driver is notified by displaying the object has been described, but the driver may be notified by voice. For example, in step S24, the control unit 4 controls a speaker (not shown) so as to notify the driver of a voice such as "caution vehicle discovery". As a result, the speaker outputs a voice such as "Caution vehicle found". Notification to the driver may be performed by both display and voice.

<1-6. Modification 4>
The control unit 4 may control the recording device 8 so as to protect and record the position information indicating the current position of the own vehicle as the caution vehicle information. In this case, the information recording control device 5 needs to be provided with a position information acquisition unit for acquiring position information.

Further, the control unit 4 may control the recording device 8 so as to protect and record the own vehicle information including the vehicle speed, acceleration, and actuator information of the own vehicle as caution vehicle information. In this case, the information recording control device 5 needs to include a own vehicle information acquisition unit that acquires own vehicle information.

<1-7. Modification 5>
When the caution vehicle detected by the caution vehicle detection unit 2 is a predetermined exclusion target vehicle, or when the driver of the own vehicle designates the caution vehicle as the exclusion target vehicle, the control unit 4 provides caution vehicle information. May be controlled not to be recorded in the recording device 8. For example, a vehicle ID, which is unique information such as a vehicle that travels in a group to which the own vehicle belongs, or a vehicle of an acquaintance, is recorded in a memory (not shown) as information for identifying a vehicle to be excluded. Then, when the caution vehicle detected by the caution vehicle detection unit 2 is the exclusion target vehicle, the control unit 4 prevents the recording device 8 from recording the information about the vehicle detected as the caution vehicle.

Further, the caution vehicle detection unit 2 determines that the driver of the own vehicle is the exclusion target vehicle when the vehicle to be detected is a predetermined exclusion target vehicle or the caution vehicle detected by the caution vehicle detection unit 2. When specified, it may not be detected as a caution vehicle. For example, a vehicle that performs group traveling frequently travels in the vicinity of its own vehicle, but does not travel that affects the traveling of its own vehicle, so such a vehicle should not be detected as a caution vehicle.

As a means for the driver of the own vehicle to designate the caution vehicle as the exclusion target vehicle, for example, a gesture operation or a voice command may be used.

<1-8. Modification 6>
In the above, the case of detecting the caution vehicle that affects the running of the own vehicle has been described, but the caution vehicle that affects the running of a specific vehicle other than the own vehicle may also be detected. In this case, the caution vehicle detection unit 2 pays attention to a vehicle that repeatedly changes lanes around the specific vehicle, a vehicle that repeatedly approaches the specific vehicle, or a vehicle that repeatedly passes the specific vehicle for a predetermined time. Detect as a vehicle.

The criterion for detecting a caution vehicle that affects the running of a specific vehicle may be stricter than the criterion for determining whether or not the driver of the own vehicle has paid attention to the caution vehicle described above. For example, the standard of time or frequency at which a vehicle affecting the running of a specific vehicle repeats the above-mentioned lane change, rapid approach, or passing is set higher than that of the own vehicle.

When recording the caution vehicle information about the caution vehicle that affects the running of a specific vehicle in the recording device 8, the content of the caution vehicle information is less than the content of the caution vehicle information about the caution vehicle that affects the running of the own vehicle. Or may be different. For example, with respect to caution vehicle information regarding a caution vehicle that affects the running of a specific vehicle, the recording time of the video is thinned out or the number of items of information to be recorded is reduced.

<1-9. Modification 7>
The condition that the judgment criteria for the attention moving object recognition unit 3 recognizes the attention moving object is looser than the judgment criteria described above, or the judgment criteria for the attention vehicle detection unit 2 to detect the attention vehicle is based on the judgment criteria explained above. When the control unit 4 determines that the driver of the own vehicle is paying attention to the caution vehicle, the control unit 4 sets the caution vehicle as a provisional caution vehicle. Then, the control unit 4 controls the recording device 8 so as to record the information regarding the temporary attention vehicle in the event recording area 20 of the recording device 8 shown in FIG. The information about the temporary attention vehicle recorded in the event recording area 20 includes the information on the position of the block corresponding to the image about the temporary attention vehicle recorded in the constant recording area 17.

As a result, after the temporary caution vehicle has left the own vehicle, the video related to the temporary caution vehicle recorded in the constant recording area 17 can be quickly searched by using the information on the temporary caution vehicle recorded in the event recording area 20. .. Then, the video can be protected and recorded as needed.

<1-10. Modification 8>
The information recording control device 5 may include a recording device 8 as a peripheral information recording unit. In this case, the configuration of the recording area of the peripheral information recording unit may be the same as the configuration of the recording area of the recording device 8 shown in FIG.

<1-11. Effect>
According to the first embodiment, when the driver pays attention to the caution vehicle, the information recording control device 5 controls to record the caution vehicle information regarding the caution vehicle in the recording device 8. Therefore, it is possible to identify a caution vehicle for driving such as road rage without the driver performing a specific operation, and to reliably record information on the collecting vehicle.

<Embodiment 2>
<2-1. Configuration>
FIG. 15 is a block diagram showing an example of the configuration of the information recording control device 35 according to the second embodiment.

As shown in FIG. 15, the information recording control device 35 includes an encounter information recording unit 36, and the control unit 4 is communicably connected to the information collection server 38 via the communication device 37. Since other configurations and operations are the same as those of the information recording control device 5 shown in FIG. 2 described in the first embodiment, detailed description thereof will be omitted here.

When the attention moving object recognized by the attention moving object recognition unit 3 and the attention vehicle detected by the attention vehicle detection unit 2 are the same, the control unit 4 determines that the driver of the own vehicle has paid attention to the attention vehicle. , The encounter information recording unit 36 records the encounter information indicating that the caution vehicle has been encountered. The encounter information is information included in the caution vehicle information described in the first embodiment. For example, the date and time when the caution vehicle detection unit 2 detects the caution vehicle, the vehicle type of the caution vehicle, the vehicle number of the caution vehicle, and the caution vehicle detection. Examples include the position where the caution vehicle is detected by the unit 2, and an image including the caution vehicle. The vehicle type of the caution vehicle and the vehicle number of the caution vehicle are obtained by image processing the image captured by the camera 9. Caution The position where the vehicle is detected may be information acquired by a position information acquisition unit that acquires position information indicating the current position of the own vehicle (not shown). Attention The image including the vehicle is a still image obtained from the image taken by the camera 9. The encounter information is not limited to this information, and may be any information that can identify a caution vehicle.

Further, the control unit 4 transmits the encounter information recorded in the encounter information recording unit 36 to the information collection server 38 via the communication device 37. It is assumed that the communication device 37 is provided inside the own vehicle and the information collection server 38 is provided outside the own vehicle.

The information collection server 38 collects the encounter information about the caution vehicle from the information record control device 35, and distributes the information about the encounter information to the information record control device 35 in response to the request from the information record control device 35. When each of the plurality of vehicles is equipped with the information record control device 35, the information collection server 38 collects encounter information from each information record control device 35 and responds to a request from each information record control device 35. Various information is distributed to each information recording control device 35.

<2-2. Operation>
FIG. 16 is a flowchart showing an example of the operation of the information recording control device 35. Since steps S31 to S34 in FIG. 16 correspond to steps S11 to S14 in FIG. 7, description thereof will be omitted here. Hereinafter, steps S35 and S36 will be described.

In step S35, when the control unit 4 determines that the driver of the own vehicle has paid attention to the caution vehicle, the control unit 4 records the encounter information indicating that the driver of the own vehicle has encountered the caution vehicle in the encounter information recording unit 36.

In step S36, the control unit 4 transmits the encounter information recorded in the encounter information recording unit 36 to the information collection server 38 via the communication device 37. The timing of transmitting the encounter information from the control unit 4 to the information collection server 38 may be a predetermined time or time interval, or may be a time requested by the information collection server 38. When the control unit 4 transmits the encounter information to the information collection server 38, measures may be taken so as not to provide unlimited information. For example, an image containing personally identifiable information such as a license plate may be masked, or the personally identifiable information may be encrypted.

The information collection server 38 may analyze the encounter information collected from the control unit 4 and distribute the analysis result in response to an external request. Examples of the outside of the delivery destination include an information recording control device 35, a mobile communication terminal, and a personal computer. The information collection server 38 may take measures such as encrypting the information when distributing the information to the outside so as not to provide unlimited information.

<2-3. Modification 1>
The information recording control device 35 may be configured to be connected to the recording device 8 as shown in FIG. The recording device 8 may protect and record the encounter information described above according to the instruction from the control unit 4. In this case, the information recording control device 35 does not have to include the encounter information recording unit 36.

<2-4. Modification 2>
FIG. 17 is a block diagram showing an example of the configuration of the information recording control device 39 according to the modified example 2.

As shown in FIG. 17, the information recording control device 39 is characterized by including a position information acquisition unit 40. Since other configurations and operations are the same as those of the information recording control device 35 shown in FIG. 15, detailed description thereof will be omitted here.

The position information acquisition unit 40 acquires position information indicating the current position of the own vehicle. For example, the position information acquisition unit 40 acquires the position information of its own vehicle by using GNSS (Global Navigation Satellite System) or the like.

The control unit 4 may record the position information of the own vehicle acquired by the position information acquisition unit 40 in the encounter information recording unit 36 as encounter information. Further, the control unit 4 may transmit the encounter information including the position information to the information collection server 38 via the communication device 37.

The information recording control device 39 may further include a map information acquisition unit (not shown). The map information acquisition unit acquires map information including a road ID that specifies a road section. The control unit 4 records the encounter information using the road ID currently being traveled by the own vehicle as the encounter information based on the position information of the own vehicle acquired by the position information acquisition unit 40 and the map information acquired by the map information acquisition unit. It may be recorded in the unit 36. Further, the control unit 4 may transmit the encounter information including the road ID to the information collection server 38 via the communication device 37.

The control unit 4 may transmit at least one of the position information and the road ID to the information collection server 38.

<2-5. Effect>
According to the second embodiment, when the information recording control device 35 determines that the driver of the own vehicle has paid attention to the caution vehicle, the information recording control device 35 records the encounter information indicating that the driver of the own vehicle has encountered the caution vehicle in the encounter information recording unit 36. Then, it is transmitted to the information collection server 38. In addition, the information recording control device 35 receives various information from the information collection server 38 that has collected the encounter information. As a result, the own vehicle can provide the driver with various information utilizing the encounter information. When the information collection server 38 collects encounter information from a plurality of vehicles, the own vehicle can receive more accurate information from the information collection server 38 and utilize it.

<Embodiment 3>
<3-1. Configuration>
FIG. 18 is a block diagram showing an example of the configuration of the information recording control device 41 according to the third embodiment.

As shown in FIG. 18, the information recording control device 41 is characterized in that the control unit 4 is connected to the gesture recognition device 42. Since other configurations and operations are the same as those of the information recording control device 5 shown in FIG. 2 described in the first embodiment, detailed description thereof will be omitted here.

The control unit 4 controls to record caution vehicle information based on the gesture operation recognized by the gesture recognition device 42. Specifically, in the control unit 4, the attention vehicle detected by the attention vehicle detection unit 2 and the attention moving body recognized by the attention moving body recognition unit 3 are the same, and the attention moving body recognition unit 3 is the attention moving body. At the same time as recognizing, when the driver of the own vehicle makes a predetermined gesture operation, the recording device 8 is controlled so as to protect and record the caution vehicle information. That is, the control unit 4 controls the recording device 8 so as to protect and record the attention vehicle information when the driver of the own vehicle pays attention to the attention vehicle and at the same time performs a predetermined gesture operation.

The gesture recognition device 42 is composed of, for example, a camera, and recognizes the gesture motion of the driver of the own vehicle. The gesture recognition device 42 is not limited to the camera, and may have any configuration as long as it can recognize the gesture movement of the driver of the own vehicle without contact.

<3-2. Operation>
FIG. 19 is a flowchart showing an example of the operation of the information recording control device 41. Since step S41, step S42, step S44, step S45, and step S47 in FIG. 19 correspond to steps S11 to S15 in FIG. 7, detailed description thereof will be omitted here. Hereinafter, steps S43 and S44 will be described.

In step S43, the control unit 4 acquires the gesture motion of the driver of the own vehicle recognized by the gesture recognition device 42.

In step S46, the control unit 4 controls the recording device 8 so as to protect and record the attention vehicle information when the driver of the own vehicle pays attention to the attention vehicle and at the same time makes a predetermined gesture operation. Predetermined gesture movements include, for example, various movements such as pointing at a caution vehicle or moving a hand. Further, "simultaneous" here means that the difference between the time when the driver pays attention to the caution vehicle and the time when the driver makes a gesture motion is within a predetermined time, for example, within 5 seconds.

<3-3. Modification 1>
Although FIG. 13 shows an example in which the attention guidance object 32 is displayed on the HUD, the gesture guidance object that guides the gesture motion to the HUD may be further displayed. The gesture guidance object may be displayed in the vicinity of the attention vehicle 31.

The attention guidance object 32 and the gesture guidance object may be deleted from the HUD when the driver performs an action corresponding to each object.

<3-4. Modification 2>
In the above, the case where the recording device 8 is controlled so as to protect and record the caution vehicle information when the driver of the own vehicle pays attention to the caution vehicle and at the same time performs a predetermined gesture operation has been described, but the present invention is limited to this. is not it. For example, the control unit 4 may control the recording device 8 to record the caution vehicle information when the driver of the own vehicle pays attention to the caution vehicle and at the same time utters a predetermined voice. Predetermined voices include, for example, "it" or "start".

For example, in the HUD shown in FIG. 13, the utterance guidance object that guides the utterance by the driver of the own vehicle may be displayed together with the attention guidance object 32. Further, it may be combined with the gesture guidance object described in the above modification example 1.

<3-5. Effect>
According to the third embodiment, the control unit 4 controls the recording device 8 so as to protect and record the caution vehicle information when the driver of the own vehicle pays attention to the caution vehicle and at the same time performs a predetermined gesture operation. do. Therefore, it is possible to accurately identify that the moving object of interest that the driver of the own vehicle has paid attention to is the attention vehicle.

<Embodiment 4>
<4-1. Configuration>
FIG. 20 is a block diagram showing an example of the configuration of the information recording control device 43 according to the fourth embodiment.

As shown in FIG. 20, the information recording control device 43 is characterized in that the control unit 4 is connected to the display device 44. Since other configurations and operations are the same as those of the information recording control device 35 shown in FIG. 15 described in the second embodiment, detailed description thereof will be omitted here.

Similar to the second embodiment, when the control unit 4 determines that the driver of the own vehicle has paid attention to the caution vehicle, the control unit 4 records the encounter information indicating that the driver of the own vehicle has encountered the caution vehicle in the encounter information recording unit 36. Further, the control unit 4 controls the display device 44 so as to display the encounter information when the vehicle existing in the vicinity of the own vehicle is a caution vehicle related to the encounter information recorded in the encounter information recording unit 36. do. That is, when the attention vehicle is re-encountered, the control unit 4 controls to notify the driver of the own vehicle that the vehicle has re-encountered. In the following, the re-encountered caution vehicle will also be referred to as the re-encountered vehicle.

In the information recording control device 43, the operation of recording the encounter information described above in the encounter information recording unit 36 and the operation of controlling to notify that the re-encountered vehicle has been re-encountered are performed in parallel. .. That is, each operation shown in FIGS. 21 and 22 described later is performed in parallel.

In the fourth embodiment, the display device 44 is described as being a HUD, but other display devices may be used.

<4-2. Operation>
FIG. 21 is a flowchart showing an example of the operation of the information recording control device 43, and shows an operation of recording the encounter information in the encounter information recording unit 36.

Since steps S51 to S55 in FIG. 21 correspond to steps S31 to S35 in FIG. 16, description thereof will be omitted here.

FIG. 22 is a flowchart showing an example of the operation of the information recording control device 43, and shows an operation showing an operation of performing control to notify that the re-encountered vehicle has been re-encountered.

In step S61, the control unit 4 acquires a vehicle ID, which is unique information such as a vehicle number of another vehicle existing in the vicinity of the own vehicle, from the peripheral situation detection device 6. The vehicle ID of the other vehicle may be a vehicle number obtained by image processing the image taken by the camera 9, or may be a vehicle ID acquired from the other vehicle by vehicle-to-vehicle communication.

In step S62, the control unit 4 collates the vehicle ID of the other vehicle acquired in step S61 with the vehicle ID included in the encounter information recorded in the encounter information recording unit 36, and the other vehicle re-encounters the vehicle. Judge whether or not. That is, the control unit 4 determines whether or not there is a re-encountered vehicle around the own vehicle. If there is a re-encountered vehicle around the own vehicle, the process proceeds to step S63. On the other hand, if there is no re-encountered vehicle around the own vehicle, the process proceeds to step S64.

In step S63, the control unit 4 controls the display device 44 so as to indicate that a re-encountered vehicle exists in the vicinity of the own vehicle. That is, the control unit 4 controls the display device 44 so as to display the re-encounter information related to the re-encounter vehicle recorded in the encounter information recording unit 36.

FIGS. 23 and 24 show an example of displaying the re-encounter object 46 indicating that the re-encounter vehicle has re-encountered on the HUD which is the display device 44. In the example of FIG. 23, the re-encounter object 46 is displayed in the vicinity of the attention vehicle 45. In the example of FIG. 24, the re-encounter object 48 is displayed so as to surround the attention vehicle 47. The control unit 4 controls the re-encounter object 46 so as not to be displayed on the HUD when the re-encounter vehicle is separated from the own vehicle by a predetermined distance.

The re-encounter object 46 may include information on at least one of the vehicle type of the re-encounter vehicle and the shape of the re-encounter vehicle. It may also include information on at least one of the re-encountered vehicle and the time and place of the past encounter.

The re-encounter object 46 and the re-encounter object 48 may be the same color as the body color of the re-encounter vehicle.

<4-3. Modification 1>
If the re-encounter vehicle is behind the own vehicle, an object indicating that the re-encounter vehicle is behind the own vehicle may be displayed. In this case, an object indicating the right side mirror or the left side mirror to be visually recognized may be displayed at an appropriate position on the HUD. For example, when the left side mirror should be visually recognized, an object indicating the left side mirror is displayed in the display area on the left side of the HUD.

Further, an object indicating that a re-encountered vehicle exists behind the own vehicle may be displayed in the rearview mirror itself or the display area for displaying the image of the electronic mirror. For example, as shown in FIG. 25, when the caution vehicle 49, which is a re-encounter vehicle, exists on the right rear side of the own vehicle, the re-encounter object 50 may be displayed in the display area 27.

<4-4. Modification 2>
In the above, the case of displaying that the re-encountered vehicle has been re-encountered has been described, but the present invention is not limited to this. For example, the driver may be notified by voice that he / she has re-encountered the re-encountered vehicle. In this case, the sound having an appropriate sound image may be output according to the direction or position where the re-encountered vehicle exists with respect to the own vehicle.

<4-5. Modification 3>
When the information recording control device 43 has a navigation function, the position of the re-encountered vehicle may be displayed on the map together with the current position of the own vehicle.

In addition, the position or frequency of the re-encountered vehicle currently re-encountered and the caution vehicle encountered in the past may be displayed so as to be known.

<4-6. Modification 4>
The information recording control device 43 may have a configuration capable of communicating with the information collection server 38 via the communication device 37, as in the information recording control device 35 described in the second embodiment. In this case, when the own vehicle re-encounters the re-encounter vehicle, which is a caution vehicle that the other vehicle has encountered in the past, the driver may be notified that the re-encounter vehicle has been re-encountered. The means of notification may be display, voice, or a combination of display and voice.

In this way, here, the caution vehicle encountered by another vehicle in the past is treated in the same manner as the re-encounter vehicle re-encountered by the own vehicle. Further, the re-encounter includes not only the case where the own vehicle re-encounters with the caution vehicle encountered in the past, but also the case where the own vehicle encounters the caution vehicle encountered by another vehicle in the past.

<4-7. Effect>
According to the fourth embodiment, when the re-encounter vehicle exists in the vicinity of the own vehicle, the control unit 4 controls to notify the driver that the re-encounter vehicle exists. As a result, the driver of the own vehicle can drive while paying attention to the re-encountered vehicle.

<Embodiment 5>
<5-1. Configuration and operation>
In the fourth embodiment, when the driver is re-encountered with a caution vehicle encountered in the past, the case where the driver is notified to that effect has been described. The fifth embodiment is characterized in that information about the caution vehicle encountered in the past is displayed regardless of whether or not the attention vehicle encountered in the past is re-encountered. Since the configuration and main operations of the information recording control device according to the fifth embodiment are the same as those of the fourth embodiment, detailed description thereof will be omitted here.

For example, when the driver performs a predetermined operation, the history of caution vehicles encountered in the past is displayed. In addition, the position or frequency of caution vehicles encountered in the past may be displayed on a map.

<5-2. Modification 1>
The information recording control device according to the fifth embodiment may have a configuration like the information recording control device 35 shown in FIG. 15 described in the second embodiment. In this case, the information recording control device may acquire the history of the caution vehicle that another vehicle has encountered in the past from the information collection server 38 and display the history including the history.

<5-3. Effect>
According to the fifth embodiment, the control unit 4 controls to display information about the caution vehicle encountered in the past regardless of whether or not the attention vehicle encountered in the past is re-encountered. As a result, the driver of the own vehicle can drive while paying attention to the caution vehicle encountered in the past.

<Hardware configuration>
Of the attention vehicle detection unit 2, the attention moving object recognition unit 3, the control unit 4, and the position information acquisition unit 40 in the information recording control devices 1, 5, 35, 39, 41, 43 described in the first to fifth embodiments. Each function is realized by a processing circuit. That is, the information recording control devices 1, 5, 35, 39, 41, 43 detect the attention vehicle, recognize the moving object of interest, control to record the attention vehicle information, and control to record the encounter information. , The processing circuit for controlling the transmission of the encounter information to the information collection server and notifying the encounter information is provided. The processing circuit is a processor (CPU (Central Processing Unit), central processing unit, processing arithmetic unit, microprocessor, microcomputer, DSP (Digital Signal Processor) that executes programs stored in memory, even if it is dedicated hardware. ) May also be used.

When the processing circuit is dedicated hardware, as shown in FIG. 26, the processing circuit 51 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, or an ASIC (Application Specific Integrated Circuit). , FPGA (Field Programmable Gate Array), or a combination of these. Caution Each function of the vehicle detection unit 2, the attention moving object recognition unit 3, the control unit 4, and the position information acquisition unit 40 may be realized by the processing circuit 51, or each function may be collectively realized by the processing circuit 51. You may.

When the processing circuit 51 is the processor 52 shown in FIG. 27, the functions of the caution vehicle detection unit 2, the attention moving object recognition unit 3, the control unit 4, and the position information acquisition unit 40 are software, firmware, or software and firmware. It is realized by the combination of. The software or firmware is written as a program and stored in the memory 53. The processor 52 realizes each function by reading and executing the program recorded in the memory 53. That is, the information recording control devices 1, 5, 35, 39, 41, 43 record the attention vehicle detection step, the attention moving object recognition step, the attention vehicle information recording control step, and the encounter information. A memory 53 is provided for storing a program in which a step of performing control, a step of controlling transmission of encounter information to an information collection server, and a step of performing control of notifying encounter information are executed as a result. Further, it can be said that these programs cause the computer to execute the procedures or methods of the attention vehicle detection unit 2, the attention moving object recognition unit 3, the control unit 4, and the position information acquisition unit 40. Here, the memory is, for example, non-volatile or volatile such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory). It may be a sex semiconductor memory, a magnetic disk, a flexible disk, an optical disk, a compact disk, a DVD (Digital Versatile Disc), or any other storage medium that will be used in the future.

Note that some of the functions of the caution vehicle detection unit 2, the attention moving object recognition unit 3, the control unit 4, and the position information acquisition unit 40 are realized by dedicated hardware, and some are realized by software or firmware. You may do so.

In this way, the processing circuit can realize each of the above-mentioned functions by hardware, software, firmware, or a combination thereof.

<System configuration>
The information recording control device described above is a system in which not only an in-vehicle navigation device, that is, a car navigation device, but also a PND (Portable Navigation Device) that can be mounted on a vehicle, a server provided outside the vehicle, and the like are appropriately combined. It can also be applied to a navigation device constructed as a navigation device or a device other than the navigation device. In this case, each function or each component of the information recording control device is distributed and arranged in each function for constructing the system.

Specifically, the function of the information recording control device can be arranged on the server. For example, as shown in FIG. 28, the user side includes a peripheral situation detection device 6, a line-of-sight detection device 7, a recording device 8, a camera 9, a millimeter-wave radar 10, an ultrasonic sensor 11, and a laser radar 12. Further, the server 54 includes a caution vehicle detection unit 2, a attention moving object recognition unit 3, and a control unit 4. With such a configuration, an information recording control system can be constructed. The same applies to the information recording control device 35 shown in FIG. 15, the information recording control device 39 shown in FIG. 17, the information recording control device 41 shown in FIG. 18, and the information recording control device 43 shown in FIG.

As described above, even if each function of the information recording control device is distributed and arranged in each function for constructing the system, the same effect as that of the above-described embodiment can be obtained.

Further, software that executes the operation according to the above embodiment may be incorporated into, for example, a server. The monitoring method realized by the server executing this software detects other vehicles that exist in the vicinity of the own vehicle and affect the driving of the own vehicle as caution vehicles, and the driver of the own vehicle pays attention to them. This is to recognize a moving body of interest, which is a moving body, and when the recognized moving body of interest and the detected attention vehicle are the same, control is performed to store information about the attention vehicle as caution vehicle information.

As described above, by incorporating the software that executes the operation according to the above embodiment into the server and operating the server, the same effect as that of the above embodiment can be obtained.

In the present invention, each embodiment can be freely combined, and each embodiment can be appropriately modified or omitted within the scope of the invention.

Although the present invention has been described in detail, the above description is exemplary in all embodiments and the invention is not limited thereto. It is understood that innumerable variations not illustrated can be assumed without departing from the scope of the present invention.

1 Information recording control device, 2 Caution vehicle detection unit, 3 Attention moving vehicle recognition unit, 4 Control unit, 5 Information recording control device, 6 Peripheral situation detection device, 7 Line-of-sight detection device, 8 Recording device, 9 Camera, 10 mm wave Radar, 11 Ultrasonic sensor, 12 Laser radar, 13 Own vehicle, 14 Other vehicle, 15 Moving object, 16 Driver, 17 Constant recording area, 18 Protection recording area, 19 Event recording area, 20 Event recording area, 21 Moving object , 22 Driver, 23 Back Mirror, 24 Right Side Mirror, 25 Left Side Mirror, 26 Display, 27 Display Area, 28 Display Area, 29 Own Vehicle, 30 Moving Vehicle, 31 Attention Vehicle, 32 Attention Guidance Object, 33 Attention Vehicle, 34 Recording start object, 35 Information recording control device, 36 Encounter information recording unit, 37 Communication device, 38 Information collection server, 39 Information recording control device, 40 Position information acquisition unit, 41 Information recording control device, 42 Gesture recognition device , 43 Information recording controller, 44 Display, 45 Attention vehicle, 46 Re-encounter object, 47 Attention vehicle, 48 Re-encounter object, 49 Attention vehicle, 50 Re-encounter object, 51 Processing circuit, 52 Processor, 53 Memory, 54 Server ..

Claims (24)

A caution vehicle detection unit that detects other vehicles that exist in the vicinity of the own vehicle and affect the running of the own vehicle as caution vehicles.
The attention moving body recognition unit that recognizes the attention moving body that is the moving body that the driver of the own vehicle is paying attention to.
When the attention moving body recognized by the attention moving body recognition unit and the attention vehicle detected by the attention vehicle detection unit are the same, a control unit that controls to record information about the attention vehicle as caution vehicle information. When,
An information recording control device. The information recording control device according to claim 1, wherein the control unit controls to record additional information including a time for recording the caution vehicle information together with the caution vehicle information. The information recording control device according to claim 1, wherein the caution vehicle information includes unique information for identifying the caution vehicle. The information recording control device according to claim 1, wherein the caution vehicle information includes an image of the caution vehicle. The caution vehicle includes a vehicle that repeatedly changes lanes around the own vehicle for a predetermined time, a vehicle that repeatedly approaches the own vehicle, and a vehicle that repeatedly passes the own vehicle. The information recording control device according to claim 1, wherein the information recording control device is characterized. The caution vehicle is a vehicle that repeatedly changes lanes around a specific vehicle other than the own vehicle for a predetermined time, a vehicle that repeatedly approaches the specific vehicle, and a vehicle that repeatedly passes the specific vehicle. The information recording control device according to claim 1, wherein the information recording control device includes. The control unit does not record the caution vehicle information when the caution vehicle is a predetermined exclusion target vehicle or when the driver of the own vehicle designates the caution vehicle as the exclusion target vehicle. The information recording control device according to claim 1, further comprising control. In the caution vehicle detection unit, when the vehicle to be detected is a predetermined exclusion target vehicle, or the driver of the own vehicle is the exclusion target vehicle for the caution vehicle detected by the caution vehicle detection unit. The information recording control device according to claim 1, wherein when the vehicle is specified, the vehicle is not detected as the caution vehicle. The attention moving body recognition unit determines that the attention moving body has been recognized when the line of sight of the driver of the own vehicle is within a predetermined range centered on the direction in which the attention moving body exists. The information recording control device according to claim 1, wherein the information recording control device is characterized. When the line of sight of the driver of the own vehicle is within a predetermined range centered on the direction in which the moving body exists in the rearview mirror provided in the own vehicle, the attention moving object recognition unit is used. The information recording control device according to claim 9, wherein it is determined that the moving object of interest has been recognized. When the moving body recognition unit of interest has the line of sight of the driver of the own vehicle within a predetermined range centered on the direction in which the moving body exists in the display of the electronic mirror provided on the own vehicle. The information recording control device according to claim 9, wherein it is determined that the moving body of interest has been recognized. The first aspect of the present invention is that, when the attention moving body recognition unit detects stress based on the facial expression of the driver of the own vehicle, it lowers a standard for determining whether or not the moving body is paying attention. The information recording control device described in. The information recording control device according to claim 1, wherein the control unit controls to record the caution vehicle information when the driver of the own vehicle performs a predetermined gesture operation. The control unit is characterized in that the attention moving body recognition unit recognizes the attention moving body, and at the same time, controls to record the attention vehicle information when the driver of the own vehicle performs the gesture operation. The information recording control device according to claim 13. The first aspect of the present invention, wherein the control unit controls notification to guide the line of sight of the driver of the own vehicle to the caution vehicle when the caution vehicle detection unit detects the caution vehicle. Information recording control device. The information recording control device according to claim 1, wherein the control unit controls to notify the driver of the own vehicle that the recording of the caution vehicle information has started. The information recording control device according to claim 1, wherein the control unit controls to notify the driver of the own vehicle that the re-encounter has occurred when the caution vehicle is re-encountered. The information recording control device according to claim 1, wherein the control unit controls to display information indicating that the vehicle has encountered the caution vehicle in the past. The information recording control device according to claim 1, wherein the control unit controls to display a point where the caution vehicle has been encountered in the past on a map. The information recording control device according to claim 1, wherein the control unit transmits the caution vehicle information to a server provided outside the own vehicle. A peripheral information recording unit for recording peripheral information of the own vehicle including the caution vehicle information is further provided.
The peripheral information recording unit has a constant recording area for constantly recording the peripheral information and a protection recording area for recording the caution vehicle information to be protected among the peripheral information recorded in the constant recording area. ,
The information recording control device according to claim 1, wherein the control unit controls to record the caution vehicle information in the protection recording area. The peripheral information recording unit is characterized in that, among the peripheral information recorded in the constant recording area, the caution vehicle information to be protected is transferred from the constant recording area to the protected recording area. 21. The information recording control device. The information recording control device according to claim 21, wherein the peripheral information recording unit records information that can search the caution vehicle information recorded in the constant recording area. Other vehicles that exist in the vicinity of the own vehicle and affect the running of the own vehicle are detected as caution vehicles.
Recognizing the moving body of interest, which is the moving body that the driver of the own vehicle is paying attention to,
An information recording control method for controlling to store information about the caution vehicle as caution vehicle information when the recognized moving object of interest and the detected attention vehicle are the same.

Images