JP2020074504A - Information processing apparatus, information processing method, and program - Google Patents

Abstract

To make it possible to allow a driver to more quickly and more accurately recognize an approaching object.SOLUTION: There is provided an information processing apparatus comprising: an image information acquisition unit that acquires image information on a picked-up image including at least an approaching object; an image creation unit that creates, based on a result of determination on an approaching state that is the state of the approaching object, a dynamic pattern provided image that is an image in which a dynamic pattern in which display on a display screen changes at a predetermined period is provided to the approaching object in the picked-up image, the image in which both the approaching object and the dynamic pattern are displayed; and a display control unit that displays the dynamic pattern provided image on the display screen.SELECTED DRAWING: Figure 2

Description

  The present disclosure relates to an information processing device, an approaching object notification method, and a program.

  In recent years, as a rear view support system for a driver to confirm the rear of the vehicle, a technique for displaying an image (captured image) captured by an in-vehicle camera on a monitor mounted on the vehicle has been developed. The driver can check the surroundings of the own vehicle by visually observing the monitor instead of the mirror such as the rearview mirror and the side mirror.

  On the other hand, the captured image and various sensor devices mounted on the vehicle detect an object relatively approaching the host vehicle (for example, another vehicle approaching from the rear) and approach the driver. A system has been developed for notifying that there is a target object (approaching target object). For example, in Patent Document 1, the distance between a vehicle and an obstacle around the vehicle is measured by a distance measuring sensor, and a plurality of LEDs are caused to emit light step by step according to the measured distance, so that the driver is obstructed with the vehicle. A technique for sensuously notifying a distance to an object is disclosed.

  Here, as a technique for calling the user's attention by attaching a predetermined pattern to a specific object in the image, for example, in Patent Document 2, images captured by a plurality of image capturing units are combined to form a panoramic image. In the generating system, when the distance to the closest subject is less than a predetermined threshold value, a zebra pattern is attached to the closest subject in the captured image to notify the user of a location that may be defective during image composition. Techniques for doing so are disclosed.

JP, 2005-47504, A JP, 2011-4340, A

  Here, in a system that notifies a driver of an approaching object, the driver is required to quickly recognize the presence of the approaching object, and the appearance of the approaching object (for example, the shape of the approaching object (vehicle type ), Approach speed, etc.) is required to be recognized more accurately. However, in the technique described in Patent Document 1, the presence of the approaching object is notified to the driver by the light emission of the LED. Therefore, in order to recognize the state of the approaching object as described above, the visual recognition by the mirror or the like is required. It was necessary and could take time to recognize the correct situation.

  In addition, since the driver is basically looking in the traveling direction through the windshield while driving, the driver does not always look at the monitor on which the captured image of the surroundings is displayed. Therefore, the driver may not be able to quickly recognize the presence of the approaching object only by adding the zebra pattern to the approaching object in the monitor as in the technique described in Patent Document 2. ..

  In view of the above circumstances, it has been required that the driver quickly recognize the presence of the approaching object and more accurately recognize the state of the approaching object in a necessary situation. Therefore, the present disclosure proposes a new and improved information processing apparatus, an approaching object notifying method, and a program that allow a driver to recognize an approaching object more quickly and more accurately.

  According to the present disclosure, a display on a display screen is performed based on an image information acquisition unit that acquires image information of a captured image that includes at least an approaching object, and a determination result for the approaching state that is the state of the approaching object. A dynamic pattern in which a dynamic pattern that changes in a predetermined cycle is an image given to the approaching object in the captured image, and the approaching object and the dynamic pattern are both displayed. An information processing apparatus is provided, which includes an image generation unit that generates an applied image and a display control unit that displays the dynamic pattern applied image on the display screen.

  Further, according to the present disclosure, the display on the display screen is predetermined based on the acquisition of the image information of the captured image including at least the approaching target object and the determination result for the approaching state that is the state of the approaching target object. A dynamic pattern that changes in a cycle of is an image given to the approaching object in the captured image, and is an image in which the approaching object and the dynamic pattern are both displayed An approaching object notification method is provided that includes generating an image and causing the display screen to display the dynamic patterning image.

  Further, according to the present disclosure, the display screen is displayed on the computer based on the function of acquiring the image information of the captured image including at least the approaching target object and the determination result for the approaching state which is the state of the approaching target object. A dynamic pattern whose display changes in a predetermined cycle is an image given to the approaching object in the captured image, and the approaching object and the dynamic pattern are both displayed. A program for realizing a function of generating a dynamic pattern-applied image and a function of displaying the dynamic pattern-applied image on the display screen is provided.

  According to the present disclosure, a dynamic pattern imparted image in which a dynamic pattern whose display on a display screen changes in a predetermined cycle is imparted to an approaching target object in a captured image including at least the target object around is generated. It Therefore, by displaying the dynamic pattern-added image on the display screen, even if the driver is not gazing at the display screen, the display changes periodically within the driver's field of view. By capturing the pattern, the driver can quickly recognize the approaching object. Further, in the dynamic pattern added image, the approaching object and the dynamic pattern are both displayed. In this way, the dynamic pattern is generated so as not to hinder the visual recognition of the target object on the display screen when the dynamic pattern is applied to the target object, so that the driver visually recognizes the display screen. Can recognize objects accurately.

  As described above, according to the present disclosure, the driver can be made to recognize the approaching object more quickly and more accurately.

FIG. 1 is a schematic diagram showing an outline of a vehicle to which an approaching object notification system according to a first embodiment of the present disclosure is applied. FIG. 1 is a functional block diagram showing a configuration example of an approaching object notifying system according to a first embodiment of the present disclosure. It is explanatory drawing for demonstrating the zebra pattern which is a specific example of a dynamic pattern. It is explanatory drawing for demonstrating the zebra pattern which is a specific example of a dynamic pattern. It is explanatory drawing for demonstrating the frame-shaped pattern which is a specific example of a dynamic pattern. It is explanatory drawing for demonstrating the frame-shaped pattern which is a specific example of a dynamic pattern. It is explanatory drawing for demonstrating the wavy pattern which is a specific example of a dynamic pattern. It is explanatory drawing for demonstrating the wavy pattern which is a specific example of a dynamic pattern. It is explanatory drawing for demonstrating the wavy pattern which is a specific example of a dynamic pattern. It is a functional block diagram which shows one structural example of the approaching object notification system which concerns on the 2nd Embodiment of this indication. It is a flow figure showing an example of 1 processing procedure of an approaching object notice method concerning a 1st and 2nd embodiment of this indication. FIG. 3 is a functional block diagram showing a configuration example of a hardware configuration of an approaching object notifying apparatus according to the first and second embodiments of the present disclosure.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, and duplicate description will be omitted.

The description will be given in the following order.
1. 1. First embodiment 1-1. Overview of approaching object notification system 1-2. Configuration of approaching object notification system 1-3. Specific example of dynamic pattern 1-3-1. Zebra pattern 1-3-2. Frame-shaped pattern 1-3-3. Wavy pattern 2. Second embodiment 3. 3. Processing procedure of approaching object notification method 4. Hardware configuration 5. Summary

<1. First Embodiment>
[1-1. Overview of approaching object notification system]
First, with reference to FIG. 1, an outline of the approaching object notification system according to the first embodiment of the present disclosure will be described. FIG. 1 is a schematic diagram showing an outline of a vehicle to which the approaching object notification system according to the first embodiment of the present disclosure is applied. In addition, in the following description, the case where the approaching object notification system according to the present embodiment is applied to a vehicle will be described. However, the present embodiment is not limited to such an example, and a driver (driver) may enter the vehicle to control the vehicle. It can be applied to all kinds of vehicles as long as it is a vehicle. In addition, in the following description, expressions indicating directions such as front, rear, and left and right indicate directions based on the driver driving the vehicle.

  Referring to FIG. 1, a vehicle 610 to which the approaching object notification system according to the first embodiment is applied is equipped with an in-vehicle camera 611 and a distance measuring sensor device 612. The vehicle-mounted camera 611 is an example of an imaging device that captures an image of the surroundings of the vehicle 610. The vehicle-mounted camera 611 is disposed so as to capture an image of a range that can be normally viewed by a vehicle-mounted mirror such as a rearview mirror and a side mirror, for example. Specifically, the vehicle-mounted camera 611 is arranged so as to capture an image of the rear, left and right rear of the vehicle 610. In the example shown in FIG. 1, one in-vehicle camera 611 is arranged at a position corresponding to the left side mirror of the vehicle 610, but the present embodiment is not limited to this example. A plurality of vehicle-mounted cameras 611 may be arranged at arbitrary positions of the vehicle 610 so that an image of a desired range can be captured.

  The image (captured image) captured by the vehicle-mounted camera 611 is displayed on a monitor (not shown) also mounted on the vehicle 610. Therefore, the driver can confirm the state around the vehicle 610 by visually recognizing the captured image displayed on the monitor. As described above, in the present embodiment, the vehicle-mounted camera 611 and the monitor displaying the captured image can substitute the vehicle-mounted mirror. The monitor may be provided at a position visually recognized by a driver inside the vehicle 610, or may be provided at a position where a vehicle-mounted mirror is generally provided instead of the mirror. When a plurality of vehicle-mounted cameras 611 are arranged, the same number of monitors as the vehicle-mounted cameras 611 may be provided so as to display captured images captured by the vehicle-mounted cameras 611, respectively.

  The distance measurement sensor device 612 is an example of a distance detection device that detects the distance between the vehicle 610 and an object around the vehicle 610. Specifically, the distance measurement sensor device 612 may be various distance measurement sensor devices such as a millimeter wave radar device, a sound wave distance measurement device, an ultrasonic distance measurement device, and an optical distance measurement device. In the example shown in FIG. 1, the distance measuring sensor device 612 is arranged so as to detect the distance to the object behind the vehicle 610 and to the rear left and right. However, the present embodiment is not limited to this example, and a plurality of distance measurement sensor devices 612 are arranged at different positions so as to detect the distances to the object in the front, rear, and left and right directions of the vehicle 610. You may.

  As described above, in the approaching object notification system according to the present embodiment, the in-vehicle camera 611 captures an image of the surroundings of the vehicle 610, and the distance measurement sensor device 612 detects the distance to the target surrounding the vehicle 610. It Here, as shown in FIG. 1, consider the case where another vehicle 620 approaches from the left rear of the vehicle 610, for example. In this case, in the present embodiment, the in-vehicle camera 611 displays the captured image including the vehicle 620 on the monitor mounted on the vehicle 610. Further, the distance measuring sensor device 612 detects the distance between the vehicle 610 and the vehicle 620. Then, a dynamic pattern added image, which is an image in which a dynamic pattern is added to the vehicle 620 in the captured image and which is an image that displays both the vehicle 620 and the dynamic pattern, is displayed on the monitor. In this way, the vehicle 620 (approaching object, approaching vehicle) approaching the driver is notified.

  Here, the dynamic pattern is a pattern in which the display on the display screen changes in a predetermined cycle. Such a dynamic pattern has an effect of appealing to the human visual acuity, in other words, it can be said that the dynamic pattern is a pattern that is easily recognized by the driver. This is due to the visual capacity (visual function) of many vertebrates, especially herbivores. Herbivores are known to have a visual field region that spreads to the outer periphery of the fovea of the eye and is sensitive to a moving body that moves horizontally with low resolution, and the visual function of herbivores is By detecting unsteady changes in the visual field, slight movements of predators can be captured. Here, the fovea is a portion located in the approximate center of the macula of the retina where cones are present at high density, and is a portion that controls high-definition visual acuity in the approximate center of the visual field. In addition, it is known that a large number of rod cells that control fluctuation perception are distributed around the fovea. In this way, in the present embodiment, the driver is alerted by utilizing the action appealing to the human visual acuity. Specifically, by displaying the dynamic pattern addition image on the monitor mounted on the vehicle 610, even if the driver is not gazing at the monitor, the dynamic pattern is displayed in the driver's field of view. By being captured, the driver can quickly recognize the approaching object.

  Further, in the dynamic pattern addition image according to the present embodiment, the vehicle 620 and the dynamic pattern are both displayed at the same time as the dynamic pattern is given to the vehicle 620. That is, the dynamic pattern is given to the vehicle 620 so as not to interfere with the visual recognition of the vehicle 620. Therefore, the driver referring to the dynamic pattern addition image displayed on the monitor can more accurately recognize the state of the vehicle 620 as the approaching object (for example, the shape (vehicle type) or approaching speed of the vehicle 620). You can

  The outline of the approaching object notification system according to the first embodiment of the present disclosure has been described above with reference to FIG. 1. As described above, according to the present embodiment, the driver can be made to recognize the approaching object approaching the own vehicle more quickly and more accurately. Hereinafter, specific functions and configurations of the approaching object notification system according to the present embodiment will be described in detail.

  In the example shown in FIG. 1, the approaching object is the four-wheel vehicle 620, but the present embodiment is not limited to this example. For example, the approaching object may be a light vehicle such as a bicycle or another type of vehicle such as a motorcycle. Further, in the present embodiment, the approaching object may be an object that is relatively close to the vehicle 610, such as a stationary object such as a wall, a utility pole, or a guardrail, or a pedestrian. An object moving at a speed sufficiently slower than that of the vehicle 610 may be included in the relative approaching object.

[1-2. Configuration of approaching object notification system]
With reference to FIG. 2, a schematic configuration of the approaching object notifying system according to the first embodiment of the present disclosure will be described. FIG. 2 is a functional block diagram showing a configuration example of the approaching object notification system according to the first embodiment of the present disclosure.

  Referring to FIG. 2, the approaching object notification system 1 according to the first embodiment of the present disclosure includes a vehicle information detection device 10, a distance detection device 20, and an approaching object notification device 30. In the present embodiment, the vehicle information detection device 10, the distance detection device 20, and the approaching object notification device 30 are provided, for example, in a vehicle. In the following description, unless otherwise specified, the vehicle means a vehicle equipped with the vehicle information detection device 10, the distance detection device 20, and the approaching object notification device 30 according to the present embodiment. . Further, in the following description, a series of processes in the approaching object notification system 1 is also referred to as approaching object notification processing. Further, since the approaching object notifying device 30 is a device that mainly performs various information processing in the approaching object notifying process, in the following description, the approaching object notifying device 30 will be referred to as the information processing device 30. Call.

  The vehicle information detection device 10 detects vehicle information indicating the state of the vehicle. Here, the vehicle information may include any information indicating the state of the vehicle. For example, the vehicle information may include information about the movement of the vehicle such as the speed of the vehicle, the number of revolutions of the engine, the state of steering, the state of gears (that is, the position of the shift lever), and the like. Further, the vehicle information may include information on lighting of various lamps such as a turn signal indicator, a headlight and a brake lamp, and an activation state of equipment such as an air conditioner, a wiper and a car navigation system.

  The vehicle information detection device 10 transmits the detected vehicle information to the approaching object notification device 30. Here, the vehicle information detecting device 10 may always detect the vehicle information, or may detect the vehicle information at a predetermined timing according to a command from the approaching object notifying device 30. Further, the vehicle information detection device 10 detects the changed vehicle information and other vehicle information when a change occurs in the vehicle information, for example, when a direction indicator, which is an indication of intention to change lanes, is turned on. You may. Further, the vehicle information detection device 10 may transmit the detected vehicle information to the approaching object notification device 30 at any time, or may transmit it at a predetermined timing according to a command from the approaching object notification device 30. Further, the vehicle information detection device 10 may transmit only the changed information to the approaching object notification device 30 when the vehicle information changes.

  The distance detection device 20 detects the distance between the vehicle and an object around the vehicle. The distance detecting device 20 corresponds to the distance measuring sensor device 612 in FIG. For example, the distance detection device 20 may be various distance measurement sensor devices such as a millimeter wave radar device, an acoustic distance measurement device, an ultrasonic distance measurement device, and an optical distance measurement device. Although only one distance detection device 20 is shown in FIG. 2, a plurality of distance detection devices 20 may be provided in the vehicle, and the distance detection device 20 detects the distance to the object in all directions around the vehicle. May be.

  The distance detection device 20 transmits information on the detected distance to the surrounding object to the approaching object notification device 30. Here, the distance detection device 20 may always detect the distance to the surrounding object, or may detect the distance at a predetermined timing according to a command from the approaching object notification device 30. Further, the distance detection device 20 may send information about the distance to the surrounding object to the approaching object notification device 30 at any time, or at a predetermined timing according to a command from the approaching object notification device 30. You may. Further, the approaching object notifying apparatus 30 detects the distance to the surrounding object with respect to the distance detecting apparatus 20 when the specific vehicle information is transmitted from the vehicle information detecting apparatus 10, and obtains the information regarding the distance. You may issue a command to transmit.

  The approaching object notification device 30 integrally controls the approaching object notification process according to the present embodiment. The approaching object notification device 30 includes an imaging unit 310, a display unit 320, and a control unit 330.

  The image capturing unit 310 has a function of capturing an image around the vehicle. The image capturing unit 310 captures a captured image including at least an object around the vehicle, and transmits image information of the captured image to the control unit 330. The image capturing unit 310 may be various types of camera devices, and can capture an image of the surroundings of the vehicle as a moving image and transmit the image information to the control unit 330 in real time. The imaging unit 310 corresponds to the vehicle-mounted camera 611 in FIG. Further, although only one image capturing unit 310 is illustrated in FIG. 2, a plurality of image capturing units 310 may be provided in the vehicle, and images of all directions around the vehicle are captured to obtain image information of the plurality of captured images. You may transmit to the control part 330.

  The display unit 320 is an output interface that visually displays various information processed by the approaching object notification device 30 and the processed result on the display screen. In the present embodiment, the display unit 320 displays the captured image captured by the image capturing unit 310 on the display screen under the control of the control unit 330. Further, the display unit 320 displays a dynamic pattern added image in which a dynamic pattern is added to the captured image on the display screen under the control of the control unit 330. In this way, since the captured image or the dynamic pattern-added image is displayed on the display screen of the display unit 320, it can be said that the display unit 320 displays the surroundings of the vehicle. Therefore, when the image capturing unit 310 captures the rear, left and right rear of the vehicle, and the display unit 320 displays the captured image and the dynamic pattern added image in the rear, left and right rear of the vehicle, the display unit 320 substitutes the vehicle-mounted mirror. It can be said that it does. Display unit 320 may be provided at a position visible to the driver inside the vehicle, or may be provided at a position where an on-vehicle mirror is generally provided instead of the on-vehicle mirror. Although only one display unit 320 is shown in FIG. 2, a plurality of display units 320 may be provided. When a plurality of image capturing units 310 are provided, the same number of display units 320 as the image capturing units 310 may be provided so as to display images captured by each of the image capturing units 310.

  The control unit 330 controls the approaching object notifying apparatus 30 in an integrated manner, and also performs various information processing in the approaching object notifying process according to the present embodiment. Hereinafter, the function and configuration of the control unit 330 will be described in detail.

  The control unit 330 includes an approach state determination unit 331, a dynamic pattern generation unit 334, an image information acquisition unit 335, an image generation unit 336, and a display control unit 337.

  The approaching state determination unit 331 determines the state of an approaching object (approaching object). Here, the state of the approaching object (approaching state) includes information such as the distance between the vehicle and the approaching object, the speed and direction of the object approaching the vehicle. Further, the state of the approaching object includes information about the degree of danger of the approaching object, which is an index indicating the risk of the approaching object colliding with the vehicle. Further, in the present embodiment, the approaching state is determined based on the information on the distance between the vehicle and the approaching object detected by the distance detecting device 20.

  The function and configuration of the approaching state determination unit 331 will be described in more detail. The approaching state determination unit 331 includes an approach information acquisition unit 332 and a risk degree determination unit 333.

  The approach information acquisition unit 332 acquires approach information that is information about an approaching target object. The approach information is, for example, the presence of an approaching object, the distance between the vehicle and the approaching object, and the speed and direction at which the approaching object approaches. In the present embodiment, the approach information acquisition unit 332 receives information about the distance between the vehicle and the approaching object from the distance detection device 20. The approach information acquisition unit 332 can acquire the approach information including, for example, the above-described content based on the information on the distance. The approach information acquisition unit 332 transmits the acquired approach information to the risk degree determination unit 333.

  Here, the approach information acquisition unit 332 may acquire the approach information at any time based on the information on the distance transmitted from the distance detection device 20 at any time, or may acquire the approach information at a predetermined timing. . The predetermined timing may be, for example, the timing when the vehicle information detection device 10 detects specific vehicle information. As described above, in the present embodiment, the approach information acquisition unit 332 may receive the vehicle information from the vehicle information detection device 10 or may acquire the approach information when the specific vehicle information is received. That is, in the present embodiment, the approach information may be acquired when the specific vehicle information is detected. In the following description, the vehicle information that triggers the approach information acquisition unit 332 to acquire the approach information is also referred to as trigger information. When the approach information acquisition unit 332 acquires the approach information according to the trigger information, the approach information acquisition unit 332 that has received the trigger information instructs the distance detection device 20 to detect the distance between the vehicle and the object. The distance may be detected by the distance detection device 20 by transmitting. In the approaching object notification process according to the present embodiment, the approach information acquisition unit 332 acquires the approaching information to perform a series of processes in the approaching object notification process. Therefore, the trigger information is the approaching object notification. It can also be said to be vehicle information that triggers the processing to start.

  Here, a specific example of the trigger information will be described. For example, the trigger information may be information about the speed of the vehicle. When the speed of the vehicle is equal to or higher than the predetermined speed, it is considered that there is a high risk when the vehicle collides with the object and there is a high need to notify the approaching object. Therefore, when the vehicle information indicating that the vehicle speed is equal to or higher than the predetermined speed is detected, the approaching object notification process may be performed.

  Further, for example, the trigger information may be information about driving of the turn signal indicator of the vehicle. If the vehicle drives either the left or right direction indicator, it is highly likely that the vehicle is trying to turn left or right or change lanes, and there is a risk of collision with an approaching object from the driver's blind spot. It Therefore, the approaching object notification process may be performed when the vehicle information indicating that the vehicle has driven the right or left direction indicator is detected.

  Further, for example, the trigger information may be information about the position of the shift lever of the vehicle. For example, when the shift lever moves from the position of "P" (parking) to another position, it is considered that the vehicle starts to move from the stopped state, and therefore the situation around the vehicle needs to be paid more attention. it is conceivable that. Therefore, the approaching object notification process may be performed when the vehicle information indicating that the position of the shift lever has moved from the position “P” to another position is detected. Further, for example, when the shift lever is in the “R” (reverse) position, it means that the vehicle is about to move backward, and the driver's field of view is narrower than when the vehicle is moving forward, and the approaching object It seems that there is a high need for notification. Therefore, the approaching object notification process may be performed when the vehicle information indicating that the shift lever is in the “R” position is detected.

  Although specific examples of trigger information have been described above, the trigger information is not limited to these examples in the present embodiment. The trigger information may be any information as long as it is information included in the vehicle information, and may be appropriately set by the driver or the designer of the approaching object notification system. For example, if the vehicle is equipped with a system for detecting the driver's line of sight and the position and posture of the head, the information indicating the state of the line of sight and the position and posture of the head detected by the system is also included. It may be included in the vehicle information, and the information may be used as the trigger information. Specifically, for example, the trigger information is information that the driver has moved his or her line of sight or head in order to confirm in advance when the lane is changed or to confirm by the direct field of view diagonally behind the lane when the lane is changed. When it is detected as, the approaching object notification process may be performed. The system that detects the driver's line of sight and the position and orientation of the head is, for example, an imaging device that captures the position and movement of the driver's eyes and head as an image, and the movement of the driver's head. Various distance measurement sensor devices that capture the change in distance, and further, based on the images acquired by these imaging devices and the distance information detected by the distance measurement sensor devices, the line of sight of the driver and the position of the head and It is configured by information indicating a state such as a posture and a control device that determines whether the information is included in the trigger information.

  As described above, the approaching object notification process according to the present embodiment may be performed on the approaching object at any time, or when the trigger information is detected, the approaching object existing at that time is performed. May be. The approaching object notification process using the trigger information has an excellent effect from an ergonomic point of view. This is because the approaching object notification process is performed when the trigger information is detected, that is, the image presented to the driver changes, so that the driver's peripheral vision is alerted only when necessary. Will be reflected in the dynamic pattern. Therefore, it is possible to prevent the dynamic pattern from being displayed frequently, and to obtain the effect of preventing the sensation of the image reflected in the field of view from becoming blunted, so that more effective alerting can be performed. The driver may arbitrarily switch whether to perform the approaching object notification process at any time or when the trigger information is detected. Further, what kind of vehicle information is used as the trigger information may be appropriately selected by the driver.

  The risk determination unit 333 determines the risk of the target object based on the approach information acquired by the approach information acquisition unit 332. Here, the degree of risk may be an index indicating the risk of the approaching object colliding with the vehicle. For example, the risk level may be expressed by a score, and the risk level determination unit 333 calculates the score representing the risk level higher as the distance between the vehicle and the approaching object is shorter and the speed of the approaching object is higher. Good. Further, the risk determination unit 333 may receive the vehicle information from the vehicle information detection device 10 and further determine the risk based on the vehicle information. That is, in the present embodiment, the risk level may be determined based on the vehicle information. The method by which the risk determination unit 333 determines the risk of the approaching object is not limited to the score method, and various methods may be used. For example, the storage unit (not shown) of the approaching object notification device 30 may store a value of the degree of risk corresponding to various situations included in the approach information and / or the vehicle information as a table. The degree determination unit 333 may determine the degree of risk by referring to the table based on the approach information and / or the vehicle information.

  Here, a specific example in which the risk determination unit 333 determines the risk based on the vehicle information will be described. For example, the risk degree determination unit 333 may determine the risk degree based on vehicle information regarding the speed of the vehicle. For example, when the speed of the vehicle is sufficiently slow and it is assumed that the vehicle is traveling in a traffic queue or in a queue waiting for a signal, the risk degree determination unit 333 causes the surrounding object (for example, other front and rear Even if the vehicle is relatively close to the vehicle, the risk may be determined to be low. In addition, for example, when the speed of the vehicle is sufficiently fast and it is assumed that the vehicle is traveling on a highway, the risk determination unit 333 determines that the surrounding object (for example, another vehicle before and after) is present. Even if the distance is about the same as when the speed is slow, the risk can be determined to be high. In this way, the risk degree determination unit 333 may determine different risk degrees according to the vehicle information, even if the determination is based on the approach information having substantially the same content.

  Further, for example, the risk determination unit 333 may determine the risk based on the vehicle information regarding the driving of the turn indicator of the vehicle. For example, when the vehicle drives either the left or right direction indicator, it is highly likely that the vehicle is trying to turn left or right or change lanes. Therefore, the risk determination unit 333 drives the direction indicator. The risk of the object existing in the direction in which the object exists may be determined to be higher than the risk of the object existing in the other direction. For example, when the left turn signal is driven while the vehicle is traveling at a predetermined speed or higher, it is assumed that the vehicle is trying to change lanes to the left lane. Therefore, the risk determination unit 333 can determine the risk of the approaching object existing in the left rear of the vehicle to be higher than that of the approaching object existing in the other direction (for example, rearward or rightward rearward).

  Further, for example, the risk degree determination unit 333 may determine the risk degree based on the vehicle information regarding the position of the shift lever of the vehicle. For example, when the shift lever is in the “R” position, that is, when the vehicle is going backward, the danger level of the approaching object existing behind the vehicle, which is relatively difficult for the driver to visually recognize, is set in another direction. It may be determined to be higher than the approaching object existing in the front or in the left-right direction, for example.

  Although the specific examples in which the risk level determination unit 333 determines the risk level based on the vehicle information have been described above, the vehicle information used by the risk level determination unit 333 to determine the risk level is not limited to these examples. The risk determination unit 333 may determine the risk based on any information included in the vehicle information. For example, the risk determination unit 333 is a vehicle that indicates the state of the driver's line of sight and the position and orientation of the head detected by the system that detects the line of sight of the driver and the position and orientation of the head as described above. The risk may be determined based on the information. Specifically, the risk determination unit 333 turns right or left when it is determined that the vehicle is turning right or left or changing lanes, for example, from changes in the driver's line of sight or the position and posture of the head. In addition, the degree of danger of an object existing in the direction in which the driver is trying to change lanes, that is, the direction in which the driver is looking and / or the direction in which the driver tilts his head May be determined higher. Here, when it is determined that the vehicle is turning right or left or is about to change lanes, for example, as a confirmation operation accompanying the lane change, the driver's line of sight, the position and posture of the head, etc. are facing right or left. The case may be when the vehicle is facing diagonally rearward. In addition, for example, the risk degree determination unit 333 may determine the risk degree based on the vehicle information indicating the line of sight of the driver. For example, when the driver's line of sight is concentrated on the front (windshield) of the vehicle, it is highly likely that the driver is not aware of the approaching object from the rear or the side. In such a case, the risk determination unit 333 may determine the risk of the approaching object from a direction in which the driver's line of sight is not relatively high. The driver or the designer of the approaching object notification system may appropriately set what kind of vehicle information the risk determination unit 333 determines the risk.

  The risk level determination unit 333 transmits risk level information, which is information about the determined risk level, to the dynamic pattern generation unit 334. The risk degree determination unit 333 may further transmit the approach information received from the approach information acquisition unit 332 to the dynamic pattern generation unit 334.

  The functions of the approach information acquisition unit 332 and the risk degree determination unit 333 included in the approach state determination unit 331 have been described above in detail. As described above, the state of the approaching object determined by the approaching state determination unit 331 is the danger information that is the approach information acquired by the approach information acquisition unit 332 and the risk degree determined by the risk degree determination unit 333. Degree information may be included. The approaching state determination unit 331 transmits information about the determined state of the approaching object to the dynamic pattern generation unit 334.

  The dynamic pattern generation unit 334 generates a dynamic pattern in which the display on the display screen of the display unit 320 changes in a predetermined cycle based on the determination result of the approaching state determination unit 331. Here, the dynamic pattern is a pattern that is given to the approaching target object on the display screen and is displayed together with the approaching target object, and is a pattern that does not hinder the visual recognition of the approaching target object on the display screen. The dynamic pattern generation unit 334 may generate the dynamic pattern when the approach information acquisition unit 332 acquires the information indicating that the approaching object exists. The dynamic pattern generation unit 334 may generate a dynamic pattern when the risk level determined by the risk level determination unit 333 is equal to or higher than a predetermined threshold value. In the present embodiment, the dynamic pattern generation processing by the dynamic pattern generation unit 334 does not necessarily mean that a pattern on the display screen is generated from the beginning, and a plurality of types prepared in advance are used. It is also possible to include a process of selecting an appropriate dynamic pattern based on the determination result of the approach state determination unit 331 from among the dynamic patterns.

  Since the dynamic pattern fluctuates in a predetermined cycle on the display screen, the driver can grasp the change in the display screen in the visual field, and can quickly recognize the presence of the approaching object. . Further, since the visual recognition of the approaching object provided with the dynamic pattern is not hindered, the driver can accurately recognize the approaching object. As described above, the dynamic pattern according to the present embodiment has a variation in shape and display that appeals to the driver's visual acuity when displayed on the display screen, and hinders the visual recognition of the approaching object that is given. The pattern is not limited as long as it does not have a pattern. For a specific example of the dynamic pattern, refer to [1-3. Specific Example of Dynamic Pattern].

  In addition, the dynamic pattern generation unit 334 may generate different dynamic patterns according to the risk level determined by the risk level determination unit 333. For example, the dynamic pattern generation unit 334 may generate a dynamic pattern having a different color according to the risk level determined by the risk level determination unit 333. Specifically, the dynamic pattern generation unit 334 can generate a dynamic pattern having a color (for example, a warning color) that is more likely to attract the driver's attention as the degree of danger is higher. For example, the dynamic pattern generation unit 334 generates a blue dynamic pattern when the risk is low, a yellow dynamic pattern when the risk is medium, and a high risk when the risk is high. May generate a red dynamic pattern.

  Further, for example, the dynamic pattern generation unit 334 may generate the dynamic pattern in which the speed at which the display fluctuates varies depending on the risk level determined by the risk level determination unit 333. Specifically, the dynamic pattern generation unit 334 may increase the speed at which the display of the dynamic pattern changes as the degree of risk increases. In this way, the dynamic pattern generation unit 334 changes the color and / or display speed of the dynamic pattern according to the degree of danger, so that the driver can intuitively know the degree of danger. Can be recognized.

  The dynamic pattern generation unit 334 transmits the generated dynamic pattern to the image generation unit 336. In addition, the dynamic pattern generation unit 334 may transmit information about the state of the approaching object determined by the approaching state determination unit 331 to the image generation unit 336.

  The image information acquisition unit 335 acquires image information of a captured image that includes at least an approaching target object. In the present embodiment, the image information acquisition unit 335 acquires the image information from the imaging unit 310. In addition, the image information acquisition unit 335 performs various kinds of processing performed in general image processing, such as black level correction processing, luminance correction processing, and white balance correction processing, on the acquired image information. Good. The image information acquisition unit 335 transmits the image information of the captured image to the image generation unit 336 and the display control unit 337.

  The image generation unit 336 is an image in which a dynamic pattern in which the display on the display screen changes in a predetermined cycle is given to the approaching target object based on the determination result of the state of the approaching target object. , A dynamic pattern-added image that is an image in which an approaching object and a dynamic pattern are displayed together. In the present embodiment, the image generation unit 336 is an image in which a dynamic pattern is added to the approaching target object in the captured image based on the determination result of the approaching state determination unit 331. A dynamic pattern-added image that is an image on which a dynamic pattern is displayed is generated. Here, the information about the state of the approaching object is transmitted from the dynamic pattern generation unit 334 to the image generation unit 336. Therefore, the image generation unit 336 can recognize at what distance in what direction of the vehicle the approaching object exists. Further, the image information of the captured image including at least the surrounding objects is transmitted from the image information acquisition unit 335 to the image generation unit 336. Therefore, the image generation unit 336 integrates the received information to associate the target object approaching the vehicle with the target object in the captured image, and the dynamic pattern is set for the target target in the captured image. Can be given. Further, the image generation unit 336 recognizes the risk level of the target object in the captured image based on the information about the state of the approaching target object, and when the risk level is equal to or higher than a predetermined threshold value, a dynamic pattern is generated. May be given. The image generation unit 336 transmits the generated dynamic pattern addition image to the display control unit 337.

  The display control unit 337 controls the drive of the display unit 320, and displays various information processed by the approaching object notification device 30 on the display screen of the display unit 320 in any format such as text, tables, graphs, and images. Display it visually. In the present embodiment, the display control unit 337 displays the dynamic pattern addition image generated by the image generation unit 336 on the display screen of the display unit 320. In addition, the display control unit 337 may display the captured image captured by the image capturing unit 310 on the display screen of the display unit 320. When a plurality of image capturing units 310 and display units 320 are provided, the display control unit 337 controls the driving of the plurality of display units 320, and for example, a plurality of captured images captured by each of the image capturing units 310, A plurality of dynamic pattern added images generated based on the captured image may be displayed on the corresponding display unit 320.

  The configuration example of the approaching object notification system 1 according to the first embodiment of the present disclosure has been described above in detail with reference to FIG. 2. Each component described above may be configured by using a general-purpose member or circuit, or may be configured by hardware specialized for the function of each component. Further, particularly in the control unit 330 of the approaching object notification device 30, the CPU or the like may perform all the functions of the respective constituent elements. Therefore, the configuration to be used can be appropriately changed according to the technical level at the time of implementing the present embodiment.

  As described above, in the first embodiment, the dynamic pattern generation unit 334 generates a dynamic pattern in which the display on the display screen of the display unit 320 changes in a predetermined cycle. Further, the image generation unit 336 is an image in which a dynamic pattern is given to an approaching object in the captured image, and is an image in which the approaching object and the dynamic pattern are both displayed, and a dynamic pattern application image. Is generated. Further, the display control unit 337 displays the dynamic pattern added image on the display screen of the display unit 320. Therefore, the dynamic pattern fluctuates in a predetermined cycle on the display screen, so that the driver can grasp the change in the display screen in the visual field, and quickly recognize the presence of the approaching object. You can Further, since the visual recognition of the approaching object provided with the dynamic pattern is not hindered, the driver can accurately recognize the approaching object. Therefore, according to the first embodiment, the driver can be notified of the approaching object more quickly and more accurately.

  Here, as another method for alerting the driver of the approaching object, the area corresponding to the approaching object in the captured image displayed on the display screen is colored in a predetermined color (for example, a warning color such as red). A method of filling it is possible. However, with this method, the driver cannot fully recognize the state of the approaching object, and it is difficult for the driver to instantly distinguish the approaching object and the relative speed with the approaching object. It can be difficult. On the other hand, as described above, in the present embodiment, a dynamic pattern is given to the approaching object on the display screen, and the dynamic pattern does not prevent the driver from visually recognizing the approaching object. Therefore, according to the present embodiment, the driver can instantly recognize the surrounding situation including the approaching object more quickly, and can accurately determine the situation and operate the own vehicle.

  Note that, in the example illustrated in FIG. 2, the approaching object notification device 30 includes the imaging unit 310, the display unit 320, and the control unit 330, but the present embodiment is not limited to this example. For example, the approaching object notification device 30 includes an input unit for a driver to input various information, a storage unit for storing various information processed by the approaching object notification device 30, and other external devices. It may further have a configuration such as a communication unit for comprehensively transmitting and receiving information. Further, the approaching object notifying apparatus 30 does not have to be configured by one device, and the respective functions of the approaching object notifying apparatus 30 may be configured by being arbitrarily separated into a plurality of devices. For example, only the image pickup unit 310 and the display unit 320 are mounted on the vehicle, the control unit 330 is mounted on an arbitrary information processing device such as a server outside the vehicle, and the image pickup unit 310 and the display unit 320 and the control unit 330 are installed. The various processes in the approaching object notification device 30 described above may be performed by mutually transmitting and receiving various types of information. Further, for example, the approaching object notifying apparatus 30 mainly performs the function related to the determination of the state of the approaching object shown in the approaching state determination unit 331, the imaging unit 310, the display unit 320, and the dynamic pattern generation. The second device that mainly performs the functions related to image processing shown in the unit 334, the image information acquisition unit 335, the image generation unit 336, and the display control unit 337 may be configured separately. Further, the first device may be the distance detection device 20, that is, the distance detection device 20 has a function regarding the state of the approaching object shown in the approach state determination unit 331, and the second device is The approaching object notifying apparatus 30 may be provided with other functions in the control unit 330 (functions related to the above image processing), and such distance detecting apparatus 20 and approaching object notifying apparatus 30 mutually exchange various information. The approaching object notification process according to the present embodiment may be performed by transmitting and receiving. Furthermore, when the approaching object notification device 30 is configured by being separated into the first device and the second device, the function of the dynamic pattern generation unit 334 is installed in the first device. You may. As described above, in the approaching object notification system 1 according to the present embodiment, each processing in the approaching object notification system 1 described above may be performed, and the approaching object notification system 1 has the configuration example illustrated in FIG. It is not limited and can have any configuration. The device configuration of the approaching object notification system 1 according to the present embodiment and the function of each of those devices may be appropriately set.

  Further, the approaching object notification system 1 according to the first embodiment is applicable even when there are a plurality of approaching objects. For example, when there are a plurality of approaching objects, the approaching state determination unit 331 may determine the approaching state for each object. Further, the dynamic pattern generation unit 334 may generate different dynamic patterns for each of the plurality of approaching objects based on the determination result of the approaching state determination unit 331. In addition, the image generation unit 336, based on the determination result of the approach state determination unit 331, a dynamic pattern addition image in which different dynamic patterns are given to each of the plurality of approaching objects in the captured image. May be generated. In the dynamic pattern-added image, for example, a dynamic pattern that is more likely to attract the driver's attention to the approaching object determined to have the highest degree of danger (for example, the speed of display change is fast, a warning color is displayed). And the like) may be given. Therefore, the driver refers to the display unit 320 on which the dynamic pattern-added image is displayed, and thereby, there are a plurality of approaching objects, the approaching speeds and directions of the approaching objects, and the approaching objects. It is possible to quickly and accurately recognize information such as the vehicle types of objects and the degree of danger in those approaching objects.

[1-3. Specific example of dynamic pattern]
Next, a specific example of the dynamic pattern according to the present embodiment will be described with reference to FIGS. 3A, 3B, 4A, 4B, and 5A to 5C. Note that FIGS. 3A, 3B, 4A, 4B, and 5A to 5C are diagrams showing a state in which the captured image or the dynamic pattern-applied image is displayed on the display screen. In the figure, the approaching object is only one vehicle, and on the display screen, among the objects included in the captured image or the dynamic pattern application image, the vehicle that is the approaching object and the dynamic object applied to the vehicle. It shows that only the pattern is displayed. 3A, FIG. 3B, FIG. 4A, FIG. 4B, and FIG. 5A to FIG. 5C, a display screen imitating the shape of an on-vehicle mirror is shown as an example of the display screen. Is not limited to this example, and may have any shape in consideration of the convenience of the driver.

(1-3-1. Zebra pattern)
First, a case where the dynamic pattern is a zebra pattern will be described with reference to FIGS. 3A and 3B. 3A and 3B are explanatory diagrams for describing a zebra pattern, which is a specific example of the dynamic pattern.

  Referring to FIG. 3A, a state in which the captured image is displayed on the display screen 410 is illustrated in the upper stage, and a state in which the moving image pattern added image is displayed on the display screen 410 is illustrated in the lower stage. That is, the display of the display screen 410 shown in the lower part shows a state in which the zebra pattern 510 that is a dynamic pattern is added to the display of the display screen 410 shown in the upper part.

  Referring to FIG. 3A, in the captured image shown in the upper stage, the approaching vehicle 420 that is the approaching object is displayed on the display screen 410. Then, in the dynamic pattern addition image shown in the lower stage, the zebra pattern 510 is displayed so as to be superimposed on the approaching vehicle 420. As described above, the dynamic pattern according to the present embodiment may be the zebra pattern 510 in which the line segments having the predetermined width are arranged at the predetermined intervals, and the dynamic pattern-added image includes the zebra pattern 510 as an approach target. It may be an image superimposed on an object. Further, the zebra pattern 510 is displayed so that the line segments forming the zebra pattern 510 move.

  FIG. 3B shows how the display of the zebra pattern 510 changes. As shown in FIG. 3B, the zebra patterns 510a, 510b, 510c may move in the left-right direction of the display screen 410 at a predetermined speed. In the example shown in FIG. 3B, the zebra pattern 510b represents a state in which the line segment in the zebra pattern 510a moves from the right to the left toward the paper surface by a predetermined distance. Similarly, the zebra pattern 510c shows that the line segment in the zebra pattern 510b has moved from the right to the left toward the paper surface by a predetermined distance, and the zebra pattern 510a shows that the line segment in the zebra pattern 510c has a predetermined distance. The figure shows the movement from right to left toward the page.

  However, in the present embodiment, the variation in the display of the zebra pattern 510 is not limited to this example, and the zebra pattern 510 may be varied in the display on the display screen 410 so as to appeal to the driver's visual acuity. The changing method may be in any manner. Here, in the zebra pattern 510, if the line segment moves in a direction different from the extending direction of the line segment in the zebra pattern 510, it can be said that the display changes. Therefore, in the zebra pattern 510, the moving direction may be any direction as long as the line segment moves so that the display varies. Further, the display of the zebra pattern 510 may be changed by periodically changing the width of the line segment or the interval between the line segments in the zebra pattern 510.

  Here, in the zebra pattern 510 according to the present embodiment, for example, the line segment that constitutes the zebra pattern 510 is semitransparently colored, and a region of the approaching vehicle 420 that overlaps with the line segment can be visually recognized by the driver. Is composed of. Therefore, the driver who confirms the display screen 410 visually recognizes that the zebra pattern 510 is moving on the approaching vehicle 420, and at the same time, sees the approaching vehicle 420 from the gap between the line segments in the zebra pattern 510 and the line segment. The image of can be seen. In this way, the zebra pattern 510 is generated so as not to prevent the driver from visually recognizing the approaching vehicle 420, so that the driver can accurately recognize the approaching vehicle 420.

[1-3-2. Frame pattern]
Next, a case where the dynamic pattern is a frame-shaped pattern will be described with reference to FIGS. 4A and 4B. 4A and 4B are explanatory diagrams for explaining a frame-shaped pattern that is a specific example of a dynamic pattern.

  Referring to FIG. 4A, a state in which the captured image is displayed on the display screen 410 is illustrated in the upper stage, and a state in which the moving image pattern added image is displayed on the display screen 410 is illustrated in the lower stage. That is, the display of the display screen 410 shown in the lower part shows a state in which a frame-shaped pattern that is a dynamic pattern is added to the display of the display screen 410 shown in the upper part.

  Referring to FIG. 4A, in the captured image shown in the upper part, the approaching vehicle 420 that is the approaching object is displayed on the display screen 410. Then, in the dynamic pattern addition image shown in the lower part, the frame-shaped pattern 520 is displayed so as to be superimposed on the approaching vehicle 420. As described above, the dynamic pattern according to the present embodiment may be a frame-shaped pattern 520 in which a plurality of concentrically arranged frames are displayed, and in the dynamic pattern-added image, the frame-shaped pattern 520 is an approach target. It may be an image superimposed on an object. Further, the frame-shaped pattern 520 is displayed such that the frame forming the frame-shaped pattern 520 is enlarged with the center of the frame as a reference.

  FIG. 4B shows how the display of the frame pattern 520 changes. As shown in FIG. 4B, the frame-shaped patterns 520a, 520b, 520c may be displayed such that the frames forming the frame-shaped patterns 520a, 520b, 520c expand at a predetermined speed. In the example shown in FIG. 4B, the frame-shaped pattern 520b represents a state in which the frame in the frame-shaped pattern 520a is enlarged by a predetermined ratio. Similarly, the frame-shaped pattern 520c represents a state in which the frame in the frame-shaped pattern 520b is further enlarged by a predetermined ratio. Further, the frame-shaped pattern 520a represents a state in which the frame in the frame-shaped pattern 520c is further enlarged by a predetermined ratio, the display of the frame of the outermost shell is erased, and a new frame is displayed in the innermost shell. ing. In this way, by varying the display of the frame-shaped patterns 520a, 520b, 520c so as to enlarge the frame, it is intuitive that the approaching vehicle 420 is approaching the driver who is viewing the display screen 410. Can be made to be recognized.

  However, in the present embodiment, the variation of the display of the frame-shaped pattern 520 is not limited to such an example, and the frame-shaped pattern 520 may vary in the display on the display screen 410 so as to appeal to the driver's visual acuity. However, the changing method may be in any manner. For example, contrary to the example shown in FIG. 4B, the display of the frame-shaped pattern 520 may change so that the frame shrinks concentrically.

  Here, similar to the zebra pattern 510 described above, in the frame-shaped pattern 520 according to the present embodiment, for example, the frame forming the frame-shaped pattern 520 is semitransparently colored, and overlaps with the frame in the approaching vehicle 420. The area where the vehicle is located is configured to be visible to the driver. Therefore, the driver who confirms the display screen 410 visually recognizes that the frame-shaped pattern 520 is moving on the approaching vehicle 420, and also detects the approaching vehicle from the gap between the frames in the frame-shaped pattern 520 and the frame. The image of 420 can be visually recognized. In this way, the frame-shaped pattern 520 is generated so as not to prevent the driver from visually recognizing the approaching vehicle 420, and thus the driver can accurately recognize the approaching vehicle 420.

[1-3-3. Wavy pattern]
Next, a case where the dynamic pattern is a wavy pattern will be described with reference to FIGS. 5A to 5C. 5A to 5C are explanatory diagrams for describing a wavy pattern that is a specific example of the dynamic pattern.

  Referring to FIG. 5A, a state in which the captured image is displayed on the display screen 410 is illustrated in the upper stage, and a state in which the moving image pattern added image is displayed on the display screen 410 is illustrated in the lower stage. That is, the display of the display screen 410 shown in the lower part shows a state in which a wavy pattern that is a dynamic pattern is added to the display of the display screen 410 shown in the upper part.

  Referring to FIG. 5A, in the captured image shown in the upper part, the approaching vehicle 420 as the approaching object is displayed on the display screen 410. Then, in the dynamic pattern addition image shown in the lower part, the wavy pattern 530 is added and displayed on the approaching vehicle 420. Specifically, in the dynamic pattern added image, the approaching vehicle 420 is distorted in a wave shape and displayed. In the example shown in FIG. 5A, the approaching vehicle 420 is distorted in a wave shape in the vertical direction and displayed. As described above, the dynamic pattern according to the present embodiment may be the wavy pattern 530 in which the approaching vehicle 420 is distorted in a wavy shape and displayed. Further, the wavy pattern 530 is displayed so that the wavy distortion moves in a predetermined direction. Note that the dynamic pattern-added image to which the wavy pattern 530 is added may be generated by distorting the approaching vehicle 420 and the area in the vicinity thereof in the captured image, or a filter for distorting and displaying the acting target in a wavy shape. (Wave filter) exists and may be generated by causing the wave filter to act on the approaching vehicle 420 and the area in the vicinity thereof in the captured image.

  FIG. 5B shows how the display of the wavy pattern 530 changes. As shown in FIG. 5B, the wavy patterns 530a, 530b, and 530c may move in the left-right direction of the display screen 410 at a predetermined speed. In the example shown in FIG. 5B, the wavy pattern 530b shows that the wavy distortion in the wavy pattern 530a moves from the right to the left toward the paper surface by a predetermined distance. Similarly, the wavy pattern 530c shows that the wavy distortion in the wavy pattern 530b has moved from the right to the left toward the paper surface by a predetermined distance, and the wavy pattern 530a shows the wavy distortion in the wavy pattern 530c being predetermined. The figure shows the movement from right to left toward the page by the distance.

  However, in the present embodiment, the variation of the display of the wavy pattern 530 is not limited to this example, and the wavy pattern 530 may be varied on the display screen 410 so as to appeal to the driver's visual acuity. The changing method may be in any manner. Further, in the example shown in FIGS. 5A and 5B, the approaching vehicle 420 is distorted in the vertical direction and displayed, but the wavy pattern 530 according to the present embodiment is not limited to such an example, and the approaching vehicle 420 is differently displayed. It may be distorted and displayed. For example, the approaching vehicle 420 may be distorted in the lateral direction, or may be distorted in a ripple shape in a concentric pattern with the vicinity of the center of the approaching vehicle 420 as a reference.

  FIG. 5C shows, as a modification of the wavy pattern 530, a dynamic pattern-applied image provided with the wavy pattern 540 that is a pattern in which the approaching vehicle 420 is distorted in the lateral direction and displayed. Here, in FIG. 5C, similar to FIG. 5A, a state in which the captured image is displayed on the display screen 410 is illustrated in the upper stage, and a state in which the moving image pattern added image is displayed on the display screen 410 is illustrated in the lower stage. Has been done. As shown in FIG. 5C, when the dynamic pattern is a wavy pattern 540 that is a pattern in which the approaching vehicle 420 is distorted in the horizontal direction, for example, the wavy distortion is moved in the vertical direction. The display of the pattern 540 may change. If the dynamic pattern is a wavy pattern in which the approaching vehicle 420 is distorted in a concentric ripple pattern based on the vicinity of the center of the approaching vehicle 420, for example, the wavy distortion spreads in a concentric circle pattern. The display of the wavy pattern may change so as to shrink or shrink.

  Here, when the dynamic patterns are the wavy patterns 530 and 540, the display of the approaching vehicle 420 on the display screen 410 is not hidden by any pattern, and the display of the approaching vehicle 420 is kept visible. Therefore, the driver who confirms the display screen 410 can visually recognize the movement of the wavy patterns 530 and 540 on the approaching vehicle 420 and also directly visually recognize the display of the approaching vehicle 420. In this way, since the wavy patterns 530 and 540 are generated so as not to prevent the driver from visually recognizing the approaching vehicle 420, the driver can accurately recognize the approaching vehicle 420.

  As described above, with reference to FIGS. 3A, 3B, 4A, 4B, and 5A to 5C, as a specific example of the dynamic pattern according to the present embodiment, a zebra pattern 510, a frame-shaped pattern 520, and a wavy pattern 530, 540 has been described in detail. As described above, according to the zebra pattern 510, the frame-shaped pattern 520, and the wavy patterns 530 and 540, the display can be changed on the display screen 410 so that the driver's attention can be called and added. The display of the target approaching vehicle 420 is kept visible. Therefore, the driver can recognize the approaching vehicle 420 more quickly and more accurately. In addition, the above [1-2. Configuration of Approaching Object Notification System], these dynamic patterns may be generated so as to have different colors according to the risk level determined by the risk level determination unit 333, or displayed. May be generated so that the speed at which they vary varies.

  Here, as another method of notifying the driver of the approaching object, for example, the area corresponding to the approaching object in the captured image displayed on the monitor provided on the vehicle is set to a predetermined color (for example, red or the like). A method of painting with a warning color) is possible. However, in such a method of filling the area corresponding to the approaching object with a predetermined color, it is impossible for the driver to visually recognize the approaching object itself, and therefore it should be originally displayed on the monitor. The information indicating the state of the approaching object may be lost, the driver may not be able to fully recognize the state of the approaching object, and quick situation determination may be difficult. On the other hand, as described above, in the dynamic pattern according to the present embodiment, the display of the approaching vehicle 420 that is the target to be added is kept visible. Therefore, according to the present embodiment, the driver can instantly recognize the surrounding situation including the approaching object more quickly, and can accurately determine the situation and operate the own vehicle.

  Here, the dynamic pattern according to the present embodiment is generated so that the display on the display screen periodically changes, but in general, a person who changes the display by driving three or more phases When viewed, it can be recognized that the display is moving in one direction. That is, in order to make the display of the dynamic pattern appear to be fluctuating to the driver, it is sufficient to generate three patterns in which the patterns are gradually moved in a predetermined direction and display them in order. By using this principle, the dynamic pattern according to the present embodiment may be generated so that the display is changed by the phase driving of at least three phases.

  The dynamic pattern according to this embodiment is not limited to the zebra pattern 510, the frame-shaped pattern 520, and the wavy patterns 530 and 540 described above, and may be another pattern. The dynamic pattern according to the present embodiment may be any pattern as long as the display on the display screen fluctuates so as to appeal to the driver's visual acuity, and does not hinder the visual recognition of the approaching target that is the target to be added, and all types. , Morphological patterns can be dynamic patterns. For example, the dynamic pattern may be a grid pattern in which line segments having a predetermined width are arranged vertically and horizontally at predetermined intervals, and the pattern is displayed so that the grid moves in a predetermined direction. May be. The driver may be able to select an arbitrary dynamic pattern from a plurality of different dynamic patterns.

<2. Second Embodiment>
Next, with reference to FIG. 6, an approaching object notifying system according to the second embodiment of the present disclosure will be described. FIG. 6 is a functional block diagram showing a configuration example of an approaching object notifying system according to the second embodiment of the present disclosure.

  Referring to FIG. 6, the approaching object notification system 2 according to the second embodiment of the present disclosure includes a vehicle information detection device 10 and an approaching object notification device 30. Here, except that the approaching object notification system 2 according to the second embodiment of the present disclosure does not include the distance detection device 20 and includes an approach information acquisition unit 332a instead of the approach information acquisition unit 332. Is similar to the first embodiment described with reference to FIG. Therefore, in the following description of the second embodiment, differences from the first embodiment will be mainly described, and detailed description of overlapping functions and configurations will be omitted.

  The approach information acquisition unit 332a according to the second embodiment is different from the approach information acquisition unit 332 according to the first embodiment in the method of acquiring the approach information. In the second embodiment, the approach information acquisition unit 332a acquires the approach information based on the image information of the captured image transmitted from the image information acquisition unit 335. The captured image captured by the image capturing unit 310 captures the surroundings of the vehicle and includes surrounding objects (for example, other vehicles). The approach information acquisition unit 332a can acquire the approach information based on the display of surrounding objects included in the captured image. As described above, in the present embodiment, the approaching state is determined based on the image information of the captured image acquired by the image information acquisition unit 335.

  As a specific method for the approach information acquisition unit 332a to acquire the approach information from the captured image, any known method can be used. For example, the approach information acquisition unit 332a detects a temporal change in the display area of the target object in the captured image, and the display area increases with the passage of time, so that the presence of the approach target object and its approach The coming direction may be acquired as the approach information. Further, the approach information acquisition unit 332a may detect the speed at which the target object approaches based on the rate at which the display area increases with time.

  Further, when a plurality of image capturing units 310 are arranged in the vehicle and there are two or more captured images obtained by capturing the object from different angles, the approach information acquisition unit 332a causes the approach information acquiring unit 332a to approach based on the plurality of captured images. Information may be acquired. When using a plurality of captured images, for example, for pixels included in the overlap area in the plurality of captured images, the distance (subject distance) to the subject (target object) corresponding to each pixel is calculated by the principle of stereo ranging. May be. The approach information acquisition unit 332a detects the time change of the calculated subject distance, and when the subject distance becomes close with the passage of time, the presence of the approaching object and the approaching direction are approached. It may be acquired as information. Further, the approach information acquisition unit 332a may detect the speed at which the target object approaches based on the rate at which the subject distance becomes closer with the passage of time.

  The function of the approach information acquisition unit 332a according to the second embodiment is the function of the approach information acquisition unit 332 described in the first embodiment, except that the approach information is acquired based on the image information of the captured image. Is the same as. Therefore, for example, the approach information acquisition unit 332a may acquire the approach information at any time based on the image information transmitted from the image information acquisition unit 335 at any time, or may acquire the approach information at a predetermined timing. . The predetermined timing may be, for example, the timing when the vehicle information detection device 10 detects specific vehicle information. As described above, in the present embodiment, the approach information acquisition unit 332a may receive the vehicle information from the vehicle information detection device 10, and acquires the approach information when the trigger information that is the specific vehicle information is received. You may. When the approach information acquisition unit 332a acquires the approach information according to the trigger information, the approach information acquisition unit 332a that receives the trigger information sends a command to the image information acquisition unit 335 to send the image information. The image information may be transmitted to the approach information acquisition unit 332a and the distance may be detected. Note that the vehicle information that can be the trigger information is specifically the above [1-2. Configuration of Approaching Object Notification System].

  The function and configuration of the approaching object notification system 2 according to the second embodiment of the present disclosure have been described above with reference to FIG. 6. In the approaching object notification system 2, the functions and configurations of the components other than the approach information acquiring unit 332a described above are the functions of the corresponding components of the approaching object notification system 1 according to the first embodiment. And the configuration. For example, as the dynamic pattern in the approaching object notification system 2, the above [1-3. The zebra pattern 510, the frame-shaped pattern 520, and the wavy patterns 530 and 540 described in “Specific example of dynamic pattern” may be used. Further, also in the second embodiment, the approaching object notifying apparatus 30 may further have other configurations not shown in FIG. 6, as in the above-described first embodiment. Further, the approaching object notification device 30 according to the second embodiment does not have to be configured by one device, and each function of the approaching object notification device 30 is configured by being arbitrarily separated into a plurality of devices. May be done.

  As described above, in the second embodiment of the present disclosure, the following effects can be obtained in addition to the effects obtained by the first embodiment. That is, in the second embodiment of the present disclosure, the approach information is acquired based on the captured image captured by the image capturing unit 310. Therefore, it is not necessary to install the distance detection device 20 in the vehicle, and the approaching object notification system can be configured at a lower cost.

<3. Processing procedure of approaching object notification method>
Next, with reference to FIG. 7, a processing procedure of the approaching object notifying method according to the first and second embodiments of the present disclosure will be described. FIG. 7 is a flowchart showing an example of a processing procedure of the approaching object notifying method according to the first and second embodiments of the present disclosure. In the following description of FIG. 7, the functions of the vehicle information detection device 10, the distance detection device 20, and the approaching object notification device 30 will be described in the above <1. First Embodiment> and <2. Second Embodiment> Since the functions are the same as those described in the second embodiment, detailed description will be omitted.

  Note that FIG. 7 illustrates an example in which the approach information acquisition units 332 and 332a acquire the approach information and the approach target object notification process is performed when the trigger information that is the specific vehicle information is detected. In the example shown in FIG. 7, specifically, the trigger information is that the turn indicator of the vehicle is driving and the speed of the vehicle is equal to or higher than a predetermined threshold value. When the trigger information is detected, it is assumed that the vehicle is trying to change lanes while traveling at a speed equal to or higher than a predetermined speed. It can be said that it is a situation in which it is highly important to notify the approaching object in the lane ahead.

  Referring to FIG. 7, first, in step S701, based on the vehicle information transmitted from the vehicle information detection device 10, the approach information acquisition units 332 and 332a determine whether or not the vehicle changes lanes. Here, the approach information acquisition units 332 and 332a may determine whether or not the vehicle changes lanes depending on whether or not the vehicle information includes information indicating that the turn signal has been driven.

  When it is determined that the vehicle does not change lanes, the approaching object notification processing is stopped, the approach information acquisition units 332 and 332a wait until the next vehicle information is transmitted, and step S701 is performed on the next vehicle information. Repeat the judgment in. When it is determined that the vehicle changes lanes, the process proceeds to step S703.

  In step S703, the approach information acquisition units 332 and 332a determine whether or not the speed of the vehicle is equal to or higher than a predetermined threshold value based on the vehicle information transmitted from the vehicle information detection device 10. Here, the approach information acquisition units 332 and 332a may make the determination based on the information about the speed of the vehicle included in the vehicle information. For example, the threshold value is set to a speed during high-speed traveling, which is considered to increase the risk of collision with surrounding objects. However, the threshold value is not limited to this example, and may be appropriately set by the driver or the designer of the approaching object notification system.

  If it is determined that the vehicle speed is less than the threshold value, the process returns to step S701. That is, the approaching object notification process is stopped, and the approaching information acquisition units 332 and 332a wait until the next vehicle information is transmitted. If it is determined that the vehicle speed is equal to or higher than the threshold value, the process proceeds to step S705.

  In step S705, the approach information acquisition units 332 and 332a determine whether or not there is an approaching vehicle that is an approaching object. Here, the above <1. First Embodiment> and <2. Second Embodiment> As described in the second embodiment, the approach information acquisition unit 332 according to the first embodiment detects the approaching vehicle based on the information about the distance to the surrounding object detected by the distance detection device 20. The presence / absence of the approaching vehicle may be determined, and the approach information acquisition unit 332a according to the second embodiment may determine the presence / absence of the approaching vehicle based on the image information of the captured image transmitted from the image information acquisition unit 335.

  If it is determined that there is no approaching vehicle, the process returns to step S701. That is, the approaching object notification process is stopped, and the approaching information acquisition units 332 and 332a wait until new vehicle information is transmitted. If it is determined that there is an approaching vehicle, the process proceeds to step S707.

  In step S707, the dynamic pattern generation unit 334 generates a dynamic pattern based on the approaching state determined by the approaching state determination unit 331. Here, the approaching state may include approaching information acquired by the approaching information acquiring units 332 and 332a and information about the risk of the approaching object determined by the risk determining unit 333. Further, the dynamic pattern generation unit 334 may adjust the speed at which the display of the dynamic pattern fluctuates, the color of the dynamic pattern, or the like, depending on the approaching state of the approaching object, particularly the degree of danger. For example, when it is determined that the degree of risk is high, such as the speed of the approaching object is high, the distance to the approaching object is short, or the like, the dynamic pattern generation unit 334 causes the driver to be strongly warned. The speed at which the display of the dynamic pattern fluctuates may be increased, or the color of the dynamic pattern may be changed to a warning color such as red. When the dynamic pattern is generated in step S707, the process proceeds to step S709.

  In step S709, the image generation unit 336 generates a dynamic pattern-added image based on the approach state determined by the approach state determination unit 331. Here, the image generation unit 336 uses the image information of the captured image acquired by the image information acquisition unit 335 to convert the dynamic pattern generated by the dynamic pattern generation unit 334 in step S707 into the captured image of the captured image. The dynamic pattern-added image may be generated by adding the approaching object to the display. When the dynamic pattern added image is generated in step S709, the process proceeds to step S711.

  In step S711, the display control unit 337 displays the dynamic pattern addition image on the display screen of the display unit 120. Even when the driver's attention is directed to other parts due to the change in the dynamic pattern displayed on the display screen of the display unit 120, the driver can confirm that something is moving on the display screen. Since it can be recognized, the presence of an approaching vehicle can be recognized quickly. In addition, since the dynamic pattern is generated so as not to obstruct the visibility of the approaching vehicle that has been applied, the driver can confirm the approaching object by checking the dynamic pattern application image displayed on the display screen. In the case of a vehicle, the vehicle type, color, etc. of the approaching vehicle can be confirmed, and the approaching object can be recognized more accurately.

  In the approaching object notification method according to the first and second embodiments, the approaching object notification is performed by repeating the processing from step S701 to step S711 described above. It should be noted that the driver takes appropriate action by referring to the dynamic pattern-added image displayed on the display screen of the display unit 120, and the danger is avoided such that the distance between the vehicle and the approaching object is expanded to a sufficiently safe distance. When it is determined that the process has been performed, the series of approaching object notification processing may be terminated, and the series of processing may be performed again from the processing shown in step S701.

  The processing procedure of the approaching object notifying method according to the first and second embodiments of the present disclosure has been described above with reference to FIG. 7. In the example illustrated in FIG. 7, when the trigger information that is the specific vehicle information is detected, the approach information acquisition units 332 and 332a acquire the approach information and the approach target object notification process is performed. The present embodiment is not limited to this example. In the present embodiment, the approach information acquisition units 332 and 332a may acquire the approach information at any time, and the approaching object notification process may be performed at any time. Further, in the example shown in FIG. 7, as shown in steps S701 and S703, the trigger information is that the turn indicator of the vehicle is driving and the speed of the vehicle is equal to or higher than a predetermined threshold value. Although a case is shown, the present embodiment is not limited to such an example. In the present embodiment, various information included in the vehicle information may be appropriately combined and used as the trigger information.

<4. Hardware configuration>
Next, the hardware configuration of the approaching object notifying apparatus 30 according to the embodiment of the present disclosure will be described in detail with reference to FIG. 8. FIG. 8 is a functional block diagram showing a configuration example of the hardware configuration of the approaching object notifying apparatus according to the first and second embodiments of the present disclosure.

  The approaching object notification device 30 mainly includes a CPU 901, a ROM 903, and a RAM 905. Further, the approaching object notification device 30 further includes a host bus 907, a bridge 909, an external bus 911, an interface 913, an imaging device 914, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and communication. A device 925 is provided.

  The CPU 901 functions as an arithmetic processing unit and a control unit, and controls all or a part of the operation in the approaching object notifying apparatus 30 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919 or the removable recording medium 927. . The CPU 901 corresponds to the control unit 330 illustrated in FIGS. 2 and 6, for example, in the first and second embodiments. The ROM 903 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 905 temporarily stores a program used by the CPU 901, parameters that change appropriately during execution of the program, and the like. These are connected to each other by a host bus 907 composed of an internal bus such as a CPU bus.

  The host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

  The imaging device 914 is a device that has a plurality of light receiving elements (photoelectric conversion elements) provided in an array, and converts the received optical signal into an electric signal to obtain an image signal that is an electric signal representing an image. is there. An imaged image can be obtained by performing various kinds of signal processing on the image signal acquired by the imaging device 914 and displaying the image signal on a display device such as a display. The image pickup device 914 may be various camera devices having various solid-state image pickup devices such as a CCD (Charge Coupled Device) and a CMOS (Complementary Metal Oxide Semiconductor). The imaging device 914 corresponds to, for example, the imaging unit 310 illustrated in FIGS. 2 and 6 in the first and second embodiments, and has a function of capturing an image of the surroundings of a vehicle in which the imaging device 914 is mounted.

  The input device 915 is an operation unit operated by a user, such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever. Further, the input device 915 may be, for example, a remote control means (so-called remote control) using infrared rays or other radio waves, or an external device such as a mobile phone or a PDA corresponding to the operation of the approaching object notification device 30. It may be the connection device 929. Further, the input device 915 is composed of, for example, an input control circuit that generates an input signal based on the information input by the user using the above-mentioned operation unit and outputs the input signal to the CPU 901. By operating the input device 915, the user (driver) of the approaching object notification device 30 can input various data to the approaching object notification device 30 and instruct a processing operation. . For example, in the first and second embodiments, the driver operates the input device 915 to cause the approach information acquisition unit 332 to acquire the approach information, and the risk determination unit 333 triggers the approach information. Various conditions in the approaching object notification procedure, such as the risk determination method and the type of dynamic pattern to be used, may be input.

  The output device 917 is configured by a device capable of visually or auditorily notifying the user of the acquired information. Examples of such a device include a CRT display device, a liquid crystal display device, a plasma display device, an EL display device such as an organic LED, a display device such as a HUD (Head-Up Display) and a lamp, a speaker and headphones. There are various types of HMI (Human Machine Interface: Human Machine Interface) such as a voice output device, a vibration (haptics) system such as a seat vibration and a steering vibration, and a printer device. The output device 917 outputs, for example, a result obtained by various processes performed by the approaching object notification device 30. Specifically, the display device displays the results obtained by the various processes performed by the approaching object notification device 30 as text or images. The display device corresponds to, for example, the display unit 320 illustrated in FIGS. 2 and 6 in the first and second embodiments. Further, the audio output device converts an audio signal composed of reproduced audio data and acoustic data into an analog signal and outputs the analog signal.

  The storage device 919 is a device for storing data configured as an example of a storage unit of the approaching object notification device 30. The storage device 919 includes, for example, a magnetic storage unit device such as a HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like. The storage device 919 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like. For example, in the first and second embodiments, the storage device 919 stores various information processed in the approaching object notification procedure. For example, in the storage device 919, various types of acquired vehicle information, acquired approach information, determined risk, captured image, captured dynamic pattern, generated dynamic pattern-added image, etc. May be stored as a history in time series.

  The drive 921 is a reader / writer for a recording medium, and is incorporated in or attached to the approaching object notifying apparatus 30. The drive 921 reads the information recorded on the removable recording medium 927 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs it to the RAM 905. The drive 921 can also write a record on a removable recording medium 927 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory. The removable recording medium 927 is, for example, a DVD medium, an HD-DVD medium, a Blu-ray (registered trademark) medium, or the like. Further, the removable recording medium 927 may be a compact flash (registered trademark) (CompactFlash: CF), a flash memory, an SD memory card (Secure Digital memory card), or the like. Further, the removable recording medium 927 may be, for example, an IC card (Integrated Circuit card) equipped with a non-contact type IC chip, an electronic device, or the like. For example, in the first and second embodiments, the drive 921 reads various information processed in the approaching object notification procedure from various removable recording media 927, or various removable recording media 927. May be written in.

  The connection port 923 is a port for directly connecting a device to the approaching object notification device 30. Examples of the connection port 923 include UART (Universal Asynchronous Receiver Transmitter), I2C (Inter-Integrated Circuit), USB (Universal Serial Bus) port, IEEE 1394 Serial Port, etc., and SCSI (SCI) port. Another example of the connection port 923 is an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, or the like. By connecting the external connection device 929 to the connection port 923, the approaching object notification device 30 acquires various data directly from the external connection device 929 or provides various data to the external connection device 929. For example, in the first and second embodiments, various types of information processed in the approaching object notification procedure are read from various types of externally connected devices 929 via the connection port 923, or various types of external devices are used. It may be written in the connection device 929.

  The communication device 925 is, for example, a communication interface including a communication device or the like for connecting to the communication network (network) 931. The communication device 925 may be, for example, a CAN (Controller Area Network), a LIN (Local Interconnect Network), a FlexRay, a MOST (Media Oriented SystemVistor Estimated Assisted Velocity Equivalent, Aligned System Assisted Velocity Estimated), a MOST (Media Oriented System Assisted Estimated Assisted Velocity), a D2B (Domestic Assisted Estimate Assisted Velocity). It is a communication card for wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB). Further, the communication device 925 may be a router for optical communication, a router for ADSL (Asymmetrical Digital Subscriber Line), a modem for various kinds of communication, or the like. The communication device 925 can transmit and receive signals and the like to and from the Internet and other communication devices, for example, according to a predetermined protocol such as TCP / IP. The communication network 931 connected to the communication device 925 is configured by a network connected by wire or wirelessly, and may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, satellite communication, or the like. . For example, in the case of the first and second embodiments, various information processed in the approaching object notification procedure by the communication device 925 is exchanged with another external device via the communication network 931. May be sent and received.

  The example of the hardware configuration capable of realizing the function of the approaching object notification device 30 according to the embodiment of the present disclosure has been described above. Each component described above may be configured by using a general-purpose member, or may be configured by hardware specialized for the function of each component. Therefore, it is possible to appropriately change the hardware configuration to be used according to the technical level at the time of implementing the present embodiment.

  Note that it is possible to create a computer program for realizing each function of the approaching object notification device 30 according to the present embodiment as described above, and install the computer program in a personal computer or the like. It is also possible to provide a computer-readable recording medium in which such a computer program is stored. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Further, the above computer program may be distributed via a network, for example, without using a recording medium.

<5. Summary>
As described above, according to the first and second embodiments of the present disclosure, the following effects can be obtained.

  In the first embodiment, the dynamic pattern generation unit 334 generates a dynamic pattern in which the display on the display screen of the display unit 320 changes in a predetermined cycle. Further, the image generation unit 336 is an image in which a dynamic pattern is given to an approaching object in the captured image, and is an image in which the approaching object and the dynamic pattern are both displayed, and a dynamic pattern application image. Is generated. Further, the display control unit 337 displays the dynamic pattern added image on the display screen of the display unit 320. Therefore, the dynamic pattern fluctuates in a predetermined cycle on the display screen, so that the driver can grasp the change in the display screen in the visual field, and quickly recognize the presence of the approaching object. You can Further, since the visual recognition of the approaching object to which the dynamic pattern is added is not hindered, the driver can accurately recognize the relative approaching speed and size of the approaching object. Therefore, according to the first embodiment, the driver can be notified of the approaching object more quickly and more accurately.

  In addition, in the second embodiment, the following effects can be obtained in addition to the effects obtained by the first embodiment. That is, in the second embodiment of the present disclosure, the approach information is acquired based on the captured image captured by the image capturing unit 310. Therefore, it is not necessary to install the distance detection device 20 in the vehicle, and the approaching object notification system can be configured at a lower cost.

  Although the preferred embodiments of the present disclosure have been described above in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can conceive various changes or modifications within the scope of the technical idea described in the claims. It is understood that the above also naturally belongs to the technical scope of the present disclosure.

  For example, in the above, as specific examples of the vehicle information used for the acquisition of the approach information by the approach information acquisition unit 332 and the determination of the risk degree by the risk degree determination unit 333, information about the speed of the vehicle, the driving of the vehicle direction indicator, Although the information about the above and the information about the position of the shift lever have been described, the present technology is not limited to such an example. For example, the vehicle information may include various information processed by the car navigation system mounted on the vehicle. Then, the approach information acquisition unit 332 and the risk degree determination unit 333, based on, for example, VICS (Vehicle Information and Communication System) information acquired by the car navigation system, of the approach information according to the road conditions and the like. Acquisition and determination of risk may be performed. Further, the approach information acquisition unit 332 and the risk determination unit 333, for example, based on the information about the lighting state of the headlamp and the information about the drive state of the wiper included in the vehicle information, the surrounding conditions (darkness, rainfall, It is also possible to obtain the approach information and determine the degree of danger according to (fume, etc.).

The following configurations also belong to the technical scope of the present disclosure.
(1) The display on the display screen has a predetermined cycle based on an image information acquisition unit that acquires image information of a captured image including at least an approaching object and a determination result for the approaching state that is the state of the approaching object. A dynamic pattern changing image that is an image given to the approaching object in the captured image, wherein the approaching object and the dynamic pattern are both displayed. An information processing apparatus, comprising: an image generation unit that generates the image; and a display control unit that displays the dynamic pattern addition image on the display screen.
(2) The approach state includes approach information that is information about the approaching object and risk information about a risk degree of the object that is determined based on the approach information. The information processing apparatus according to (1), wherein the pattern is generated based on the determined risk.
(3) The information processing device according to (2), wherein the dynamic pattern is generated so as to have different colors according to the determined risk level.
(4) The information processing device according to (2) or (3), wherein the dynamic pattern is generated such that the display changes at different speeds in accordance with the determined risk level.
(5) The dynamic pattern is a zebra pattern in which line segments having a predetermined width are arranged at predetermined intervals and the line segments are displayed so as to move. The information processing device according to any one of (1) to (4), which is an image in which the zebra pattern is superimposed on the target object.
(6) The dynamic pattern is a frame-shaped pattern in which a plurality of concentrically arranged frames are displayed so as to be enlarged with the center of the frame as a reference. The information processing apparatus according to any one of (1) to (4) above, which is an image in which a frame-shaped pattern is superimposed on the target object.
(7) The dynamic pattern is a wavy pattern in which the object is distorted and displayed in a wavy shape, and the wavy distortion is displayed so as to move in a predetermined direction. (1) to (4) The information processing apparatus according to any one of 1.
(8) The information processing device according to any one of (1) to (7), wherein the display of the dynamic pattern is changed by at least three-phase driving.
(9) The approaching state includes approaching information that is information about the object approaching the vehicle, and when the specific vehicle information is detected as vehicle information indicating the state of the vehicle, the approaching information is obtained. The information processing device according to any one of (1) to (8), wherein
(10) The approaching state includes approaching information that is information about the object approaching a vehicle, and risk degree information about a risk degree of the object determined based on the approaching information. The information processing apparatus according to any one of (1) to (9), wherein the degree of risk is determined based on vehicle information indicating the state of the vehicle.
(11) The information processing device according to (9) or (10), wherein the vehicle information includes information about the speed of the vehicle.
(12) The information processing device according to any one of (9) to (11), wherein the vehicle information includes information about driving of a turn indicator of the vehicle.
(13) The information processing device according to any one of (9) to (12), wherein the vehicle information includes information about a position of a shift lever of the vehicle.
(14) The information processing device according to any one of (9) to (13), wherein the vehicle information includes information about a state of a line of sight of a driver of the vehicle.
(15) The approaching state is determined based on information about a distance to the target object detected by a distance detection device that detects a distance to the target object in the surroundings, (1) to (14). The information processing apparatus according to any one of 1.
(16) The information processing device according to (15), wherein the distance detection device includes a millimeter wave radar device.
(17) The information processing device according to any one of (1) to (14), wherein the approaching state is determined based on the image information of the captured image acquired by the image information acquisition unit. ..
(18) The information processing apparatus according to (17), further including an image capturing unit configured to capture the captured image including at least the target object in the periphery.
(19) The display on the display screen fluctuates in a predetermined cycle based on the acquisition of image information of the captured image including at least the approaching object and the determination result for the approaching state, which is the state of the approaching object. Generating a dynamic pattern-added image in which a dynamic pattern is an image provided to the approaching target object in the captured image, and the approaching target object and the dynamic pattern are both displayed. And displaying the dynamic pattern application image on the display screen.
(20) The display on the display screen has a predetermined cycle based on a function of acquiring image information of a captured image including at least an approaching object in a computer and a determination result of an approaching state that is a state of the approaching object. A dynamic pattern applied image in which the dynamic pattern that fluctuates in the image is given to the approaching target object in the captured image, and the approaching target object and the dynamic pattern are both displayed. A program for realizing a function of generating and a function of displaying the dynamic pattern addition image on the display screen.

1, 2 Approaching object notification system 10 Vehicle information detecting device 20 Distance detecting device 30 Approaching object notifying device 310 Imaging unit 320 Display unit 330 Control unit 331 Approaching state determination unit 332 Approach information acquisition unit 333 Danger degree determination unit 334 Dynamic Pattern generation unit 335 Image information acquisition unit 336 Image generation unit 337 Display control unit

The present disclosure relates to an information processing device, an information processing method, and a program.

Claims (20)

An image information acquisition unit that acquires image information of a captured image including at least an approaching object,
A dynamic pattern in which the display on the display screen fluctuates in a predetermined cycle is an image given to the approaching target object in the captured image based on the determination result for the approaching state that is the state of the approaching target object. And an image generation unit that generates a dynamic pattern-applied image that is an image in which both the object and the dynamic pattern that are approaching are displayed,
A display control unit for displaying the dynamic pattern addition image on the display screen,
An information processing device comprising: The approaching state includes approach information that is information about the approaching object, and risk information that is information about the risk of the object determined based on the approach information,
The dynamic pattern is generated based on the determined risk level,
The information processing apparatus according to claim 1. The dynamic pattern is generated to have different colors depending on the determined risk level.
The information processing apparatus according to claim 2. The dynamic pattern is generated such that the speed at which the display changes varies depending on the determined risk level.
The information processing apparatus according to claim 2. The dynamic pattern is a zebra pattern in which line segments having a predetermined width are arranged at predetermined intervals, and the line segments are displayed so as to move,
The dynamic pattern-added image is an image in which the zebra pattern is superimposed on the object,
The information processing apparatus according to claim 1. The dynamic pattern is a frame-shaped pattern in which a plurality of frames arranged concentrically are displayed so as to be enlarged with the center of the frame as a reference,
The dynamic pattern-added image is an image in which the frame-shaped pattern is superimposed on the object.
The information processing apparatus according to claim 1. The dynamic pattern is a wavy pattern that is displayed such that the object is distorted in a wavy shape, and the wavy distortion is moved in a predetermined direction.
The information processing apparatus according to claim 1. The display of the dynamic pattern varies depending on the phase drive of at least three phases,
The information processing apparatus according to claim 1. The approaching state includes approaching information that is information about the object approaching the vehicle,
When the specific vehicle information is detected as the vehicle information indicating the state of the vehicle, the approach information is acquired.
The information processing apparatus according to claim 1. The approaching state includes approach information that is information about the object approaching the vehicle, and risk information that is information about the risk of the object determined based on the approach information,
The degree of risk is determined further based on vehicle information indicating the state of the vehicle,
The information processing apparatus according to claim 1. The vehicle information includes information about the speed of the vehicle,
The information processing device according to claim 9. The vehicle information includes information about driving a turn signal indicator of the vehicle,
The information processing device according to claim 9. The vehicle information includes information about a position of a shift lever of the vehicle,
The information processing device according to claim 9. The vehicle information includes information about the state of the line of sight of the driver of the vehicle,
The information processing device according to claim 9. The approaching state is determined based on information about the distance to the target object detected by a distance detection device that detects a distance to the target object in the vicinity,
The information processing apparatus according to claim 1. The distance detection device includes a millimeter wave radar device,
The information processing device according to claim 15. The approaching state is determined based on the image information of the captured image acquired by the image information acquisition unit,
The information processing apparatus according to claim 1. Further comprising an imaging unit that captures the captured image including at least the target object around
The information processing apparatus according to claim 17. Acquiring image information of a captured image including at least an approaching object,
A dynamic pattern in which the display on the display screen fluctuates in a predetermined cycle is an image given to the approaching target object in the captured image based on the determination result for the approaching state that is the state of the approaching target object. And generating a dynamic pattern-applied image that is an image in which the approaching object and the dynamic pattern are both displayed,
Displaying the dynamic pattern-added image on the display screen,
A method of notifying an approaching object, including. On the computer,
A function of acquiring image information of a captured image including at least an approaching object,
A dynamic pattern in which the display on the display screen fluctuates in a predetermined cycle is an image given to the approaching target object in the captured image based on the determination result for the approaching state that is the state of the approaching target object. A function of generating a dynamic pattern-applied image, which is an image in which both the object and the dynamic pattern approaching are displayed,
A function of displaying the dynamic pattern addition image on the display screen,
A program for realizing.