JP2019087207A - Video display controller, video display device, video display control method, and video display control program - Google Patents

Abstract

To provide a video display controller, a video display device, a video display control method, and a video display control program which are capable of displaying the illumination color of a traffic light to be followed by other vehicles so as to be quickly recognized.SOLUTION: A video display controller 20 comprises: a traffic light information acquisition unit 25; a video acquisition unit 26; a video recognition processing unit 27; a traffic light correspondence determination unit 28; and a display control unit 29. The traffic light information acquisition unit 25 acquires lighting color information of a traffic light which an own vehicle is approaching. The video acquisition unit 26 acquires video data capturing a front side of the own vehicle. The video recognition processing unit 27 recognizes other vehicle from the image data and detects a position and a moving direction of the other vehicle. The traffic light correspondence determination unit 28 associates the lighting color information of the traffic light to be followed by the other vehicle on the basis of the position and the moving direction of the other vehicle detected by the video recognition processing unit 27. The display control unit 29 performs a processing for displaying the lighting color information associated by the traffic light correspondence determination unit 28 with the position corresponding to the other vehicle.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a video display control device, a video display device, a video display control method, and a video display control program.

  An image display apparatus such as a car navigation apparatus mounted on a mobile object such as a vehicle displays map information on the display unit and displays various information such as traffic lights, public facilities, and stores contained in the displayed map. Provide the user with information on the surrounding area. In addition, a HUD (Head-Up Display) that displays a virtual image in the field of view of the driver provides information by displaying vehicle information such as speed, and improves convenience.

  For example, the video display device described in Patent Document 1 includes a communication unit, an image analysis unit, and a controller, and displays a lighting color virtual image of a traffic light on the HUD. The communication unit wirelessly receives the lighting color of the traffic signal that the vehicle is about to pass, and the image analysis unit analyzes the actual landscape image of the traveling direction of the vehicle captured by the camera, and determines whether the traffic signal is present in the real image. judge. The controller causes the HUD to display a lighting color virtual image indicating the lighting color of the traffic light based on the lighting color of the traffic light input from the communication unit when the traffic light is not present in the real scene image.

JP, 2016-112984, A

  The image display device described in Patent Document 1 displays the lighting color virtual image on the HUD, but can intuitively recognize the correspondence between the other vehicle existing at the intersection and the vicinity thereof and the traffic signal information that the other vehicle should follow. It has not reached to provide information. For example, at a time difference type intersection, when the user tries to turn the subject vehicle to the right, it can not recognize that the oncoming lane is prohibited from going straight, and confirms stopping of the other vehicle on the oncoming lane by the time it turns right. It takes a long time, and it is also inconvenient.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image display control apparatus and an image display control apparatus capable of rapidly recognizing the lighting color of a traffic light to be followed by another vehicle. Abstract: An apparatus, an image display control method, and an image display control program are provided.

  A video display control apparatus according to an aspect of the present invention includes a traffic light information acquisition unit for acquiring lighting color information of a traffic light approached by the own vehicle, a video acquisition unit for acquiring video data obtained by photographing the front of the own vehicle, In the other vehicle information detection unit that recognizes the other vehicle from the video data acquired by the acquisition unit and detects the position and movement direction of the other vehicle, and in the position and movement direction of the other vehicle detected by the other vehicle information detection unit A display for performing processing of displaying lighting color information associated with the traffic light correspondence determination unit at a position corresponding to the other vehicle based on the traffic light correspondence determination unit associating the lighting color information of the traffic light to be followed by the other vehicle And a control unit.

  Another aspect of the present invention is a video display control method. In this video display control method, a traffic signal information acquisition step of acquiring lighting color information of a traffic light approaching the host vehicle, a video acquisition step of acquiring video data obtained by photographing the front of the host vehicle, and the video acquisition step The other vehicle information detecting step of recognizing the other vehicle from the image data and detecting the position and moving direction of the other vehicle, and the other vehicle based on the position and moving direction of the other vehicle detected by the other vehicle information detecting step A traffic light correspondence determination step of correlating lighting color information of a traffic light to be followed by a vehicle, and a display control step of displaying lighting color information corresponding to the traffic light correspondence determination step at the position corresponding to the other vehicle. Prepare.

  According to the present invention, the lighting color of a traffic light to be followed by another vehicle can be displayed in a readily recognizable manner.

FIG. 1 is a block diagram showing a configuration of a video display device including a video display control device according to Embodiment 1. It is a schematic diagram for demonstrating the example of the intersection provided with the traffic light which the own vehicle approaches. It is a chart showing an example of signal information. It is a schematic diagram which shows the example of the video data which the imaging | video acquisition part acquired. FIGS. 5A to 5C are schematic views showing display examples by the display control unit. It is a flowchart which shows the procedure of an image display process. FIG. 7 is a block diagram showing a configuration of a video display device including the video display control device according to Embodiment 2. It is a schematic diagram for demonstrating the display of the lighting color information by a video projection part. FIG. 18 is a schematic view showing a display example by the display control unit according to the third embodiment. It is a flowchart which shows the procedure of an image display process. It is a schematic diagram for demonstrating the arrow-type traffic signal which concerns on a modification.

  Hereinafter, the present invention will be described based on preferred embodiments with reference to FIG. 1 to FIG. The same or equivalent constituent elements and members shown in the respective drawings are denoted by the same reference numerals, and redundant description will be omitted as appropriate. In addition, dimensions of members in each drawing are shown appropriately enlarged or reduced for easy understanding. In each drawing, a part of members which are not important in describing the embodiment is omitted and displayed.

(Embodiment 1)
FIG. 1 is a block diagram showing the configuration of a video display device 100 including the video display control device 20 according to the first embodiment. The image display apparatus 100 acquires an image obtained by photographing the front of the host vehicle, and acquires lighting color information of a traffic light approaching the host vehicle. The image display apparatus 100 recognizes another vehicle from the acquired image data, and detects the position and movement direction of the other vehicle. The image display apparatus 100 associates lighting color information of a traffic light to be followed by the other vehicle based on the position and moving direction of the other vehicle, and displays the lighting color information at a position corresponding to the other vehicle. The image display apparatus 100 is, for example, a car navigation apparatus mounted on a mobile object such as a vehicle or a portable apparatus that can be used in the vehicle.

  The video display device 100 includes a GPS receiver 11, a storage unit 12, a communication unit 13, an imaging unit 14, a display unit 15, and a video display control device 20. In addition, the video display device 100 may have an audio output unit for providing guidance to the user by voice.

  The GPS receiver 11 receives a GPS signal from a GPS satellite, and outputs the received GPS signal to the video display control device 20. The storage unit 12 is a storage device configured by, for example, a solid state drive (SSD), a hard disk, a CD-ROM, a DVD, etc., and stores map information and a recognition dictionary for recognizing an image. The map information also includes information on roads and points where traffic lights are installed. The map information including the information of the point where the traffic signal is installed is stored in the storage unit 12 and output to the video display control device 20, and also communicates with an information providing server (not shown) using a communication device, and the information It may be acquired from the providing server.

  The communication unit 13 receives traffic signal information including the status of the traffic signal from the traffic signal information transmitting apparatus 5 installed on the road by wireless communication or optical wireless communication. The traffic signal information includes information on the lighting color of the traffic signal corresponding to each entry direction to the point where the traffic signal is installed. The point at which the traffic signal is installed is, for example, the center of the intersection at the intersection where the traffic signal is installed, and the crosswalk at the crosswalk where the traffic signal is installed instead of the intersection. And a position representative of the traffic light.

  The imaging unit 14 is, for example, a camera mounted forward in a vehicle body or a cabin of the host vehicle. The imaging unit 14 shoots the front of the host vehicle and generates video data in a moving image format or a still image format. The display unit 15 is configured of a liquid crystal display, an organic electro luminescence (EL) display, a light emitting diode (LED) display, and the like. The display unit 15 displays map information, current position of the vehicle, information such as a travel route, and information on an operation based on an instruction from the video display control device 20. In addition, the display unit 15 may be a HUD.

  The video display control device 20 includes a current position information acquisition unit 21, a map information acquisition unit 22, a position determination unit 23, a direction specification unit 24, a traffic light information acquisition unit 25, a video acquisition unit 26, a video recognition processing unit 27, and traffic light correspondence determination. A unit 28 and a display control unit 29 are provided. The image display control device 20 is constituted by, for example, a CPU, and executes the processing by the above-described units according to a computer program stored in a non-volatile memory (not shown) and various information used for the computer program.

  In the image display control device 20, the current position information acquisition unit 21 calculates the current position (latitude, longitude) of the vehicle based on the signal acquired from the GPS receiver 11 that receives the signal from the GPS satellite. The current position information acquisition unit 21 outputs the information on the current position of the vehicle obtained by the calculation to the position determination unit 23 and the direction identification unit 24. The map information acquisition unit 22 acquires, from the storage unit 12, map information including information on the existing position of the traffic signal. The map information acquisition unit 22 outputs the map information acquired from the storage unit 12 to the position determination unit 23.

  The position determination unit 23 approaches the traffic signal based on the current position of the host vehicle input from the current position information acquisition unit 21 and the map information including the information on the presence position of the traffic signal input from the map information acquisition unit 22. It is determined whether the The determination as to whether the vehicle is approaching the traffic light is made based on conditions such as whether the vehicle is located within a predetermined distance (for example, 100 m) from the position where the traffic light is present. When the position determination unit 23 determines that the host vehicle is located within a predetermined distance from the presence position of the traffic signal, the direction identification unit 24 and the image acquisition unit indicate a traffic signal approach signal indicating that the host vehicle is approaching the traffic signal. Output to 26

  When the signal approach signal is input from the position determination unit 23, the direction identifying unit 24 identifies the approach direction to the point where the traffic signal is installed. The direction specifying unit 24 calculates the moving direction of the own vehicle based on the history of the current position of the own vehicle input from the current position information acquisition unit 21. The direction specifying unit 24 specifies the approach direction to the point where the traffic signal is installed, based on the current position of the host vehicle and the movement direction of the host vehicle obtained by calculation.

  The signal information acquisition unit 25 acquires signal information via the communication unit 13. As described above, the traffic light information includes information on the lighting color of the traffic light corresponding to each entry direction to the point where the traffic light is installed. FIG. 2 is a schematic view for explaining an example of an intersection provided with a traffic light which the own vehicle approaches, and FIG. 3 is a chart showing an example of traffic light information. The intersection shown in FIG. 2 crosses a road extending north to south and a road extending east to west, and the approach direction to the point where the traffic signal is installed is from four directions of north, south, east, west.

  The vehicle S shown in FIG. 2 is located to the south of the intersection, and the moving direction is the north direction, and the approach direction to the traffic light is from the south side. Other vehicles A to C exist near the intersection. The traffic signal information shown in FIG. 3 is a green light for the approach from the south side and the north side, and a red signal for the approach from the west side and the east side. Similar to FIG. 2, assuming that the host vehicle S enters the intersection from the south side, the entry from the south side to the intersection is in the same direction as the host vehicle S on the traveling path on which the host vehicle S travels. The approach from the north side to the intersection hits the opposite direction of the host vehicle S on the traveling path on which the host vehicle S travels. The approach from the west to the intersection corresponds to traveling from the left to the right with respect to the host vehicle at the intersection. In addition, the approach from the east side to the intersection corresponds to heading from the right to the left with respect to the host vehicle at the intersection.

  The video acquisition unit 26 acquires video data obtained by imaging the front of the host vehicle from the imaging unit 14, and outputs the video data to the video recognition processing unit 27. The video acquisition unit 26 may acquire video data from the imaging unit 14 after the signal approach signal is input from the position determination unit 23. The video recognition processing unit 27 recognizes another vehicle from the video data input from the video acquisition unit 26 based on the recognition dictionary stored in the storage unit 12.

  FIG. 4 is a schematic view showing an example of the video data acquired by the video acquisition unit 26. As shown in FIG. In the video data shown in FIG. 4, for example, there is a host vehicle entering the intersection from the south side, and an intersection extending in the lateral direction (east-west direction) intersecting with the traveling path extending in the longitudinal direction The road is visible. The other vehicle D is present in the opposite lane of the traveling road, and the other vehicle E is present on the left side of the intersection.

  The recognition dictionary stored in the storage unit 12 includes shape data and the like when various vehicles are viewed from the front, rear, left, and right sides. The image recognition processing unit 27 extracts the shape pattern represented in the image data, and recognizes the other vehicle by collating with the shape data included in the recognition dictionary. The video recognition processing unit 27 recognizes the other vehicle D and the other vehicle E, for example, from the video data shown in FIG. The video recognition processing unit 27 can recognize other vehicles from video data using a known image recognition processing method developed in various fields. The video recognition processing unit 27 corresponds to the other vehicle information detection unit in the present invention. The other vehicle information detection unit may use another sensor instead of or in combination with recognition processing based on video data. For example, an ultrasonic sensor, LiDAR (Laser Imaging Detection and Ranging), or the like may be used.

  The image recognition processing unit 27 further detects the position and the moving direction of the other vehicle recognized from the image data. In the present embodiment, the video recognition processing unit 27 may detect the position in the video data as the position of the other vehicle. Also, the image recognition processing unit 27 detects the approach direction to the point where the traffic light is installed as the movement direction of the other vehicle based on the movement history of the other vehicle recognized in the plurality of image data changing from moment to moment Do. For example, in the video data shown in FIG. 4, the video recognition processing unit 27 detects that the approach direction is from the north side as the movement direction of the other vehicle D based on the video data acquired every moment. Further, the video recognition processing unit 27 detects that the approach direction is from the west side as the movement direction of the other vehicle E. At this time, the image recognition processing unit 27 may recognize that the moving direction of the other vehicle D is the opposite direction and the moving direction of the other vehicle E is the left direction from the left in relation to the host vehicle.

  Based on the position and movement direction of the other vehicle recognized by the image recognition processing unit 27, the traffic signal correspondence determination unit 28 associates the lighting color information of the signal to which the other vehicle should follow, and transmits the other control to the display control unit 29. The lighting color information associated with is output. The traffic signal correspondence determination unit 28 uses the traffic signal information acquired by the traffic signal information acquisition unit 25 to associate the lighting color information of the traffic signal that the other vehicle should follow with respect to the other vehicle recognized by the video recognition processing unit 27. For the other vehicle D recognized from the video data in FIG. 4, for example, the traffic signal correspondence determination unit 28 may use the traffic signal illustrated in FIG. 3 because the moving direction is the opposite direction of the host vehicle (the approach direction is from the north). Using the information, the lighting color of the traffic light that the other vehicle D should follow is associated with blue. Further, since the traffic signal correspondence determination unit 28 has the moving direction from the left to the right with respect to the other vehicle E (the entering direction is from the west), the lighting color of the traffic signal to be followed by the other vehicle E is red. Associate with.

  The display control unit 29 performs a process of displaying on the display unit 15 the video data to which the lighting color information correlated with the traffic signal correspondence judging unit 28 is added at the position corresponding to the other vehicle recognized by the video recognition processing unit 27 . FIGS. 5A to 5C are schematic views showing display examples by the display control unit 29. FIG. The display example of FIG. 5A is a display in which the other vehicle D and the other vehicle E are semi-transparently filled with the lighting color of the traffic light to be followed. The filling range of the other vehicle is a range such as a rectangle including the inside of the outline of the recognized other vehicle and the range of the other vehicle.

  In the display example of FIG. 5B, the windows of the other vehicle D and the other vehicle E are filled in with the lighting color of the traffic light to be followed. In this case, the recognition dictionary of the storage unit 12 includes shape data of window parts of various vehicles, and the video recognition processing unit 27 collates the shape data of the window parts included in the recognition dictionary with each other. Recognize windows of other vehicles. The image recognition processing unit 27 may detect, as a window portion, a portion darker than the other portion from the center to the upper portion of the vehicle in the vertical direction, for example, in the shape pattern representing the other vehicle in the image data.

  In the display example of FIG. 5C, a balloon frame shape display filled with the lighting color of the traffic light to be followed is added to the peripheral portions of the other vehicle D and the other vehicle E. The display of the lighting color information of the traffic signal in the peripheral part of the other vehicle D and the other vehicle E is not limited to the display form shown in FIG. 5C, and may be a figure or the like surrounding a part or the whole of the other vehicle. The arrow may also indicate the moving direction of the vehicle.

  Next, the operation of the video display control device 20 according to the first embodiment will be described based on the video display process. FIG. 6 is a flowchart showing the procedure of the video display process. The current position information acquisition unit 21 of the image display control device 20 calculates and acquires the current position (latitude, longitude) of the vehicle based on the signal acquired from the GPS receiver 11 that receives signals from GPS satellites. Start (S1). The map information acquisition unit 22 acquires, from the storage unit 12, map information including information on the presence position of the traffic signal around the current position of the vehicle (S2). The map information acquisition unit 22 may acquire only the information of the existing position of the traffic light in the traveling direction of the host vehicle as the information of the existing position of the traffic light.

  The position determination unit 23 is based on the current position of the host vehicle input from the current position information acquisition unit 21 and the map information including the information on the location of the traffic signal input from the map information acquisition unit 22. It is judged whether it is approaching the traffic light (S3). When the position determination unit 23 determines that the host vehicle is not approaching the traffic light (S3: NO), the determination in step S3 is performed based on the current position information input from the current position information acquisition unit 21 every moment. repeat.

  When it is determined in step S3 that the host vehicle is approaching the traffic light (S3: YES), the direction identification unit 24 identifies the approach direction of the host vehicle to the point where the traffic signal is installed (S4). For example, as shown in FIG. 2, the direction specifying unit 24 specifies that the host vehicle enters from the south side to a point where the traffic signal is installed. The signal information acquisition unit 25 acquires signal information via the communication unit 13 (S5). The traffic signal information includes information on the lighting color of the traffic signal corresponding to each entry direction to the point where the traffic signal is installed. The image acquisition unit 26 acquires image data obtained by imaging the front of the host vehicle from the imaging unit 14 (S6).

  The video recognition processing unit 27 recognizes the other vehicle from the video data, and detects the position and the moving direction of the recognized other vehicle (S7). The detection of the position and movement direction of the other vehicle detects the distance and direction from the own vehicle to the other vehicle based on, for example, the recognition position of the other vehicle in the video data, and based on the recognition position movement history for each frame of the video data. To detect the moving direction. The traffic signal correspondence determination unit 28 associates lighting color information of a traffic light that the other vehicle should follow, based on the position and the movement direction of the other vehicle recognized by the video recognition processing unit 27 (S8). The display control unit 29 performs processing for displaying on the display unit 15 the video data to which the lighting color information correlated with the traffic signal correspondence judging unit 28 is added at the position corresponding to the other vehicle recognized by the video recognition processing unit 27. (S9), the process ends.

  As shown in FIGS. 5 (a) to 5 (c), the image display control device 20 lights the color of the traffic light that the other vehicle should follow at the position corresponding to the other vehicle. Information is added and displayed on the display unit 15. As a result, the image display control device 20 can display the lighting color of the traffic light that the other vehicle follows and can quickly recognize it, and the user can easily grasp the lighting color of the traffic light that the other vehicle follows It will be.

  For example, at the intersection where there is a time difference type traffic signal, the image display control device 20 may face the other vehicle that is facing when the lighting color of the traffic signal in the oncoming lane is red when the host vehicle on the traveling road tries to turn right. The red lighting color information is displayed at the position corresponding to. The user can easily know from the display of the video display control device 20 that the lighting color of the traffic light in the opposite lane is red, and can quickly turn the vehicle to the right.

  The position determination unit 23 determines whether or not the vehicle is approaching the point at which the traffic signal is installed, and outputs a traffic signal approach signal to the image acquisition unit 26 when it is determined that the vehicle is approaching. The video acquisition unit 26 acquires the video data from the imaging unit 14 after the signal approach signal is input, so that the video data is not unnecessarily acquired even though it is not approaching the traffic light. Can be reduced.

  As shown in FIG. 5B, the video display control device 20 adds lighting color information of the traffic light to the window of the other vehicle and displays it on the display unit 15, thereby displaying the lighting color on the body color of the other vehicle. And can be displayed separately. Similarly, as shown in FIG. 5C, the video display control device 20 adds the lighting color information of the traffic light to the peripheral portion of the other vehicle and displays the lighting color on the other vehicle by displaying it on the display unit 15. It can be displayed separately from the body color of.

Second Embodiment
In the first embodiment, the video display control device 20 adds the lighting color information of the traffic light to the position corresponding to the other vehicle, and displays the acquired video data on the display unit 15. The lighting color information may be displayed so as to overlap with the landscape. FIG. 7 is a block diagram showing the configuration of a video display device 100 including the video display control device 20 according to the second embodiment. The video display apparatus 100 according to the second embodiment includes the video projection unit 16 as a HUD, and the display control unit 29 performs processing corresponding to the display of lighting color information of a traffic light in the video projection unit 16. The configuration and operation other than those particularly described below with respect to the image display apparatus 100 according to the second embodiment are the same as the configuration and the operation described in the first embodiment, and the description will be omitted for the sake of brevity.

  FIG. 8 is a schematic view for explaining display of lighting color information by the video projection unit 16. The image projection unit 16 is disposed, for example, in or on the dashboard below the windshield 90 of the host vehicle, and displays the virtual image 60 in front of the windshield 90 or the combiner. The image projection unit 16 emits image light based on the display image output from the display control unit 29, reflects the light by the projection mirror 16a, and projects the image light onto the windshield 90 or the combiner. The image projection unit 16 reflects the projected image light on the windshield 90 or the combiner and reflects a virtual image 60 superimposed on the scenery in front of the vehicle on the front of the windshield.

  The display control unit 29 generates a display image in which the image filled with the lighting color indicated by the lighting color information is generated at a position on the driver's line of sight with respect to the other vehicle, and outputs the generated display image to the video projection unit 16. The image projection unit 16 emits an image light based on the display image output from the display control unit 29, so that the virtual image is filled in with the lighting color indicated by the lighting color information at the position on the driver's line of sight with respect to the other vehicle. Project 60a.

  When the range of the image obtained by imaging the front of the host vehicle by the imaging unit 14 matches the range of the virtual image projected by the image projection unit 16, the display control unit 29 acquires the image data acquired by the image acquiring unit 26. A display image may be generated in which an image filled with a signal color is arranged at the position of the other vehicle recognized above. If the range of the image obtained by imaging the front of the host vehicle by the imaging unit 14 does not match the range of the virtual image projected by the image projection unit 16, the display control unit 29 determines the range of the image and the virtual image. The display image may be generated in which the image filled with the signal color is disposed at a position corresponding to the position of the other vehicle recognized on the video data acquired by the video acquisition unit 26 in consideration of the positional displacement amount of.

  The video display control device 20 according to the second embodiment operates by the video display processing equivalent to that of FIG. However, in step S9 shown in FIG. 6, the display control unit 29 generates a display image in which the image filled with the lighting color associated with the traffic signal correspondence determination unit 28 is arranged at the position corresponding to the other vehicle. By performing a process of causing the unit 16 to project, lighting color information is displayed at the position of another vehicle, and the process is ended.

  Assuming that the scenery in front of the host vehicle seen by the driver through the windshield 90 is a scenery corresponding to the video data shown in FIG. A virtual image filled in with the lighting color indicated by the lighting color information is displayed at a position on the driver's line of sight with respect to the other vehicle E. With the image projection unit 16 displaying a virtual image, the driver can view the scenery in front of the vehicle as shown in FIGS. 5A to 5C through the windshield 90.

  In the image display control device 20, in the scenery in front of the host vehicle seen by the driver through the windshield 90, the virtual image filled in with the lighting color associated with the traffic signal correspondence judgment unit 28 overlaps the position corresponding to the other vehicle. Display on By this, the image display control device 20 can display the lighting color of the traffic light that the other vehicle follows and can quickly recognize it, and the user looks at the lighting color of the traffic light that the other vehicle follows by looking at the front It will be easy to grasp.

(Embodiment 3)
The image display control device 20 according to the third embodiment detects the traveling speed of another vehicle, determines that the other vehicle is not stopped, and the lighting color information associated with the other vehicle is yellow or red. And an image indicating that the other vehicle is moving is displayed at a position corresponding to the other vehicle. The configurations and operations other than those particularly described below with respect to the image display apparatus 100 according to the third embodiment are the same as the configurations and operations described in the first and second embodiments, and descriptions thereof will be omitted for the sake of brevity.

  The video recognition processing unit 27 of the video display control device 20 detects the traveling speed of the other vehicle based on the movement history of the other vehicle recognized in the plurality of video data that changes from time to time, regarding the recognized other vehicle. Output to the display control unit 29. When the display control unit 29 determines that the other vehicle is not stopped based on the traveling speed detected by the video recognition processing unit 27 and the lighting color information correlated with the traffic signal correspondence judging unit 28 is yellow or red In addition, the processing which displays the picture which shows that the other vehicle is moving to the position which corresponds to the other vehicle is done. The display control unit 29 compares the detected traveling speed of the other vehicle with a threshold (for example, 1 km / hour), and determines that the other vehicle is stopped when the traveling speed is less than the threshold, If there is, it is determined that the other vehicle has not stopped.

  FIG. 9 is a schematic view showing a display example by the display control unit 29 according to the third embodiment. The display control unit 29 performs a process of displaying an arrow as shown in FIG. 9 at a position corresponding to the other vehicle as a video indicating that the other vehicle is moving. The display control unit 29 may change the length of the arrow according to the traveling speed of the other vehicle, or may change the color for filling the arrow while keeping the length constant. When changing the color for filling the arrow, for example, the display control unit 29 changes the color from light red to dark red as the traveling speed of another vehicle increases from low speed to high speed.

  FIG. 10 is a flowchart showing the procedure of the video display process. In FIG. 10, the processes of steps S11 to S16 and step S18 are the same as the processes of steps S1 to S6 and step S8 shown in FIG. The video recognition processing unit 27 recognizes the other vehicle from the video data, and detects the position, the moving direction, and the traveling speed for the recognized other vehicle (S17). The display control unit 29 performs a process of displaying on the display unit 15 the video data to which the lighting color information correlated with the traffic signal correspondence judging unit 28 is added at the position corresponding to the other vehicle recognized by the video recognition processing unit 27 (S19).

  The display control unit 29 determines that the other vehicle is not stopped based on the traveling speed of the other vehicle, and the condition that the lighting color information correlated with the other vehicle by the traffic signal correspondence determination unit 28 is yellow or red It is determined whether the condition is satisfied (S20). If the display control unit 29 determines that the condition is satisfied in step S20 (S20: YES), the display control unit 29 performs a process of displaying an image indicating that the other vehicle is moving (S21), and ends the process. If the display control unit 29 determines that the condition is not satisfied in step S20 (S20: NO), the process ends.

  As shown in FIG. 9, the video display control device 20 warns the user of the own vehicle by displaying a video indicating that the other vehicle is moving to a position corresponding to the other vehicle. Can. In the display example shown in FIG. 9, the image showing that the other vehicle is moving is an arrow, but it may be an image of a mark or a character of an arbitrary shape.

(Modification)
FIG. 11 is a schematic view for explaining an arrow type traffic signal according to a modification. The image display apparatus 100 acquires arrow type traffic signal information shown in FIG. 11, and displays lighting color information of a traffic signal to be followed by another vehicle so as to include the content of the traffic regulation by the arrow. The traffic signal information acquisition unit 25 acquires arrow type traffic signal information via the communication unit 13. For example, when the traffic light in the opposite lane is red and the right turn mark is on and the right turn is possible, the traffic light correspondence judgment unit 28 lights red at a position corresponding to the other vehicle present in the straight lane Information is displayed, and blue lighting color information is displayed at a position corresponding to another vehicle present in the right turn lane.

Next, features of the video display control device 20, the video display device 100, the video display control method, and the video display control program according to the first to third embodiments will be described.
The video display control device 20 includes a traffic signal information acquisition unit 25, a video acquisition unit 26, a video recognition processing unit 27 (other vehicle information detection unit), a traffic signal correspondence determination unit 28, and a display control unit 29. The traffic signal information acquisition unit 25 acquires lighting color information of a traffic signal that the host vehicle approaches. The video acquisition unit 26 acquires video data obtained by photographing the front of the host vehicle. The video recognition processing unit 27 recognizes the other vehicle from the video data acquired by the video acquisition unit 26, and detects the position and the moving direction of the other vehicle. The traffic signal correspondence determination unit 28 associates lighting color information of a traffic signal that the other vehicle should follow, based on the position and the movement direction of the other vehicle detected by the video recognition processing unit 27. The display control unit 29 performs a process of displaying the lighting color information associated with the traffic signal correspondence judging unit 28 at a position corresponding to the other vehicle. As a result, the image display control device 20 can display the lighting color of the traffic light that the other vehicle follows and can quickly recognize it, and the user can easily grasp the lighting color of the traffic light that the other vehicle follows It will be.

  The video display control device 20 further includes a video projection unit 16 that projects video light in front of the driver of the host vehicle. The display control unit 29 causes the video projection unit 16 to project the lighting color information associated with the traffic signal correspondence determination unit 28 on the position on the driver's line of sight with respect to the other vehicle detected by the video recognition processing unit 27. As a result, the image display control device 20 can display the lighting color of the traffic light that the other vehicle follows and can quickly recognize it, and the user can visually check the lighting color of the traffic light that the other vehicle follows. It will be easy to grasp.

  Further, the video recognition processing unit 27 recognizes a window portion in another vehicle. The display control unit 29 performs a process of displaying the lighting color information associated with the traffic signal correspondence judging unit 28 at the position corresponding to the window part. Thereby, the image display control apparatus 20 can distinguish the display of the lighting color from the body color of the other vehicle.

  The video recognition processing unit 27 also detects the traveling speed of the other vehicle. When the display control unit 29 determines that the other vehicle is not stopped based on the traveling speed detected by the video recognition processing unit 27 and the lighting color information correlated with the traffic signal correspondence judging unit 28 is yellow or red In addition, the processing which displays the picture which shows that the other vehicle is moving to the position which corresponds to the other vehicle is done. Thereby, the video display control device 20 can display a video indicating that the other vehicle is moving, and can draw attention to the user of the own vehicle.

  The video display device 100 includes the above-described video display control device 20 and an imaging unit 14 that generates video data obtained by imaging the front of the host vehicle. The video acquisition unit 26 acquires video data generated by the imaging unit 14. As a result, the video display device can display the lighting color of the traffic light that the other vehicle follows and can quickly recognize it, and the user can easily understand the lighting color of the traffic light that the other vehicle follows. Become.

  The video display control method further includes a signal information acquisition step, a video acquisition step, a video recognition processing step (other vehicle information detection step), a signal correspondence determination step, and a display control step. The traffic signal information acquisition step acquires lighting color information of a traffic signal that the host vehicle approaches. The image acquisition step acquires image data obtained by photographing the front of the host vehicle. The video recognition processing step recognizes the other vehicle from the video data acquired by the video acquisition step, and detects the position and the moving direction of the other vehicle. In the traffic signal correspondence determination step, lighting color information of a traffic signal to be followed by the other vehicle is correlated based on the position and the movement direction of the other vehicle detected by the video recognition processing step. The display control step performs processing for displaying the lighting color information associated with the traffic signal correspondence determination step at a position corresponding to the other vehicle. According to this image display control method, the lighting color of the traffic light that the other vehicle follows can be displayed and recognized promptly, and the user can easily grasp the lighting color of the traffic light that the other vehicle follows become.

  The video display control program causes the computer to execute a traffic signal information acquisition step, a video acquisition step, a video recognition processing step (other vehicle information detection step), a traffic signal correspondence determination step, and a display control step. The traffic signal information acquisition step acquires lighting color information of a traffic signal that the host vehicle approaches. The image acquisition step acquires image data obtained by photographing the front of the host vehicle. The video recognition processing step recognizes the other vehicle from the video data acquired by the video acquisition step, and detects the position and the moving direction of the other vehicle. In the traffic signal correspondence determination step, lighting color information of a traffic signal to be followed by the other vehicle is correlated based on the position and the movement direction of the other vehicle detected by the video recognition processing step. The display control step performs processing for displaying the lighting color information associated with the traffic signal correspondence determination step at a position corresponding to the other vehicle. According to the video display control program, the lighting color of the traffic light which the other vehicle follows can be displayed and recognized promptly, and the user can easily grasp the lighting color of the traffic light which the other vehicle follows become.

  The above has been described based on the embodiment of the present invention. It is understood by those skilled in the art that these embodiments are exemplifications, and that various modifications and alterations are possible within the scope of the present invention, and such variations and modifications are also within the scope of the present invention. It is about to be Accordingly, the descriptions and drawings herein are to be considered as illustrative and not restrictive.

16 image projection unit, 20 image display control device, 25 traffic signal information acquisition unit,
26 image acquisition unit, 27 image recognition processing unit (other vehicle information detection unit),
28 traffic signal determination unit, 29 display control unit, 100 video display device.

Claims (7)

A traffic signal information acquisition unit that acquires lighting color information of a traffic signal that the host vehicle approaches;
A video acquisition unit for acquiring video data obtained by photographing the front of the host vehicle;
Another vehicle information detection unit that recognizes the other vehicle from the video data acquired by the video acquisition unit and detects the position and the moving direction of the other vehicle;
A traffic signal correspondence determination unit that associates lighting color information of a traffic light that the other vehicle should follow based on the position and movement direction of the other vehicle detected by the other vehicle information detection unit;
A display control unit for performing processing of displaying lighting color information associated with the traffic signal correspondence judging unit at a position corresponding to the other vehicle;
An image display control apparatus comprising: It further comprises an image projection unit that projects image light in front of the driver of the host vehicle,
The display control unit causes the video projection unit to correspond to the position on the driver's line of sight with respect to the other vehicle detected by the other vehicle information detection unit, with the lighting color information associated with the traffic light correspondence determination unit. The image display control apparatus according to claim 1, wherein the image display control apparatus is configured to project. The other vehicle information detection unit recognizes a window portion of the other vehicle,
The video display control apparatus according to claim 1 or 2, wherein the display control unit performs processing of displaying lighting color information associated with the traffic signal correspondence judging unit at a position corresponding to the window portion. . The other vehicle information detection unit detects the traveling speed of the other vehicle,
The display control unit is determined that the other vehicle is not stopped based on the traveling speed detected by the other vehicle information detection unit, and the lighting color information associated with the traffic signal correspondence determination unit is yellow or red. The image display according to any one of claims 1 to 3, characterized in that, when there is a process, an image indicating that the other vehicle is moving is displayed at a position corresponding to the other vehicle. Control device. The video display control apparatus according to any one of claims 1 to 4.
An imaging unit that generates video data obtained by imaging the front of the host vehicle;
And the video acquisition unit acquires video data generated by the imaging unit. A traffic signal information acquisition step of acquiring lighting color information of a traffic signal that the host vehicle approaches;
A video acquisition step of acquiring video data obtained by photographing the front of the host vehicle;
The other vehicle information detection step of recognizing the other vehicle from the video data acquired by the video acquisition step and detecting the position and the moving direction of the other vehicle;
A traffic signal correspondence determining step of correlating lighting color information of a traffic signal to which the other vehicle should follow based on the position and movement direction of the other vehicle detected by the other vehicle information detection step;
A display control step of performing processing of displaying lighting color information associated with the traffic signal correspondence determination step at a position corresponding to the other vehicle;
A video display control method comprising: A traffic signal information acquisition step of acquiring lighting color information of a traffic signal that the host vehicle approaches;
A video acquisition step of acquiring video data obtained by photographing the front of the host vehicle;
The other vehicle information detection step of recognizing the other vehicle from the video data acquired by the video acquisition step and detecting the position and the moving direction of the other vehicle;
A traffic signal correspondence determining step of correlating lighting color information of a traffic signal to which the other vehicle should follow based on the position and movement direction of the other vehicle detected by the other vehicle information detection step;
A display control step of performing processing of displaying lighting color information associated with the traffic signal correspondence determination step at a position corresponding to the other vehicle;
An image display control program that causes a computer to execute the program.

Images