JP2018019155A - Display controller for vehicle, display system for vehicle, display control method for vehicle and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow for appropriate confirmation around a vehicle.SOLUTION: A display controller for vehicle includes a rear video data acquisition unit 42 for acquiring first video data from a rear camera 110 for photographing the rear of a vehicle, a side rear video data acquisition unit 41 for acquiring side rear video data from a right rear camera 120 and a left rear camera 130 for photographing the right and left rear of the vehicle, a travel state information acquisition unit 60 for acquiring information indicating the travel state of the vehicle, a video synthesis unit 52 for combining the right rear video data and left rear video data on upper right and left, according to the travel state acquired by the travel state information acquisition unit 60, and a display control unit 70 controlling a rear view monitor 140 for displaying the rear video of the vehicle to display the rear video data combined by the video synthesis unit 52.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a vehicle display control device, a vehicle display system, a vehicle display control method, and a program.

  A technique related to a so-called electronic mirror that displays an image from a rear camera that captures a rear peripheral region of a vehicle is known. Unlike a conventional optical room mirror, the electronic mirror is a real image of a two-dimensional image, so it may be difficult to recognize the sense of distance of the subject and the driver may feel uncomfortable. Thus, an in-vehicle display device that suppresses misrecognition of a sense of distance between the host vehicle and an object photographed by a camera is known (for example, see Patent Document 1). There is also known a vehicular rearward viewing system that eliminates the complexity of the visual field adjustment operation and displays right and left rear images without a sense of incongruity (see, for example, Patent Document 2).

JP 2006-066332 A JP 2011-217318 A

  The driver visually recognizes the rear view monitor and the left and right side view monitors in order to check the periphery of the vehicle during driving. Since the rear view monitor and the left and right side view monitors are set apart from each other, the line of sight is moved to check the surroundings of the vehicle. In addition, the amount of information that the driver can recognize in a short time during driving is limited. Therefore, it is desirable to display an image with an appropriate amount of information on the rear view monitor and the left and right side view monitors at a timing when the driver needs information. Thus, a technique that enables confirmation of an appropriate vehicle periphery is desired.

  The present invention has been made in view of the above, and an object thereof is to enable appropriate confirmation of the periphery of a vehicle.

  In order to solve the above-described problems and achieve the object, a vehicle display control device according to the present invention is arranged so as to face the rear of the vehicle, and rear image data from a rear camera that captures the rear of the vehicle. A rear video data acquisition unit for acquiring, and a rear side for acquiring side rear video data from a side rear camera that is arranged to face the rear of the vehicle on the left and right sides of the vehicle and captures the left and right sides of the vehicle A video data acquisition unit, a driving status information acquisition unit that acquires information indicating the driving status of the vehicle, and the rear side of the rear video data according to the driving status acquired by the driving status information acquisition unit A video synthesis unit that synthesizes video data, and a display control unit that displays the rear video data synthesized by the video synthesis unit on a display device that displays the rear video of the vehicle.

  The vehicle display system according to the present invention includes the vehicle display control device and at least one of the display device, the rear camera, and the side rear camera.

  The vehicle display control method according to the present invention includes a rear video data acquisition step that is arranged to face the rear of the vehicle and acquires rear video data from a rear camera that captures the rear of the vehicle, and the left and right sides of the vehicle A side rear image data acquisition step for acquiring side rear image data from a side rear camera that captures the left and right rear sides of the vehicle, and information indicating a traveling state of the vehicle. A driving situation information acquisition step for acquiring the image, a video synthesis step for synthesizing the side rear video data on the left and right upper sides of the rear video data according to the driving situation acquired by the driving status information acquisition step, and the video synthesis step And a display control step of displaying the rear video data synthesized by the information on a display device that displays the rear video of the vehicle.

  The program according to the present invention is arranged so as to face the rear of the vehicle, acquires a rear video data from a rear camera that captures the rear of the vehicle, and the vehicle on the left and right sides of the vehicle. A side rear image data acquisition step for acquiring side rear image data from a side rear camera that images the left and right rear sides of the vehicle, and traveling for acquiring information indicating the traveling state of the vehicle A situation information acquisition step, a video synthesis step of synthesizing the side rear video data on the left and right upper sides of the rear video data according to the driving situation acquired by the driving status information acquisition step, and a rear synthesized by the video synthesis step A display control step of displaying video data on a display device that displays a rear image of the vehicle, and operates as a vehicle display control device To be executed by a computer.

  According to the present invention, there is an effect that it is possible to make it possible to appropriately check the vicinity of the vehicle.

FIG. 1 is a schematic diagram illustrating a configuration example of a vehicle display system according to the first embodiment. FIG. 2 is a schematic diagram illustrating a configuration example of the vehicle display system according to the first embodiment. FIG. 3 is a block diagram illustrating a configuration example of the vehicle display system according to the first embodiment. FIG. 4 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the first embodiment. FIG. 5 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 6 is a diagram illustrating an example of an image displayed on the right side view monitor of the vehicle display system according to the first embodiment. FIG. 7 is a diagram illustrating an example of an image displayed on the left side view monitor of the vehicle display system according to the first embodiment. FIG. 8 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 9 is a flowchart showing the flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the first embodiment. FIG. 10 is a diagram illustrating another example of the video data captured by the rear camera of the vehicle display system according to the first embodiment. FIG. 11 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 12 is a diagram illustrating another example of an image displayed on the right side view monitor of the vehicle display system according to the first embodiment. FIG. 13 is a diagram illustrating another example of an image displayed on the left side view monitor of the vehicle display system according to the first embodiment. FIG. 14 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 15 is a flowchart showing a flow of processing in the control unit of the vehicle display control device of the vehicle display system according to the second embodiment. FIG. 16 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the second embodiment. FIG. 17 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the second embodiment. FIG. 18 is a block diagram illustrating a configuration example of the vehicle display system according to the third embodiment. FIG. 19 is a flowchart illustrating a process flow in the control unit of the vehicle display control device of the vehicle display system according to the third embodiment. FIG. 20 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the third embodiment. FIG. 21 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the third embodiment. FIG. 22 is a flowchart showing a flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the fourth embodiment. FIG. 23 is a flowchart illustrating a process flow in the control unit of the vehicle display control device of the vehicle display system according to the fifth embodiment. FIG. 24 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the fifth embodiment. FIG. 25 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the fifth embodiment. FIG. 26 is a flowchart showing the flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the sixth embodiment. FIG. 27 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the sixth embodiment. FIG. 28 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the sixth embodiment. FIG. 29 is a flowchart showing the flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the seventh embodiment.

  Exemplary embodiments of a vehicle display control device 10, a vehicle display system 1, a vehicle display control method, and a program according to the present invention will be described below in detail with reference to the accompanying drawings. In addition, this invention is not limited by the following embodiment.

[First embodiment]
The vehicle display system 1 is mounted on the vehicle 100 and displays the periphery of the vehicle. FIG. 1 is a schematic diagram illustrating a configuration example of a vehicle display system according to the first embodiment. FIG. 2 is a schematic diagram illustrating a configuration example of the vehicle display system according to the first embodiment. FIG. 3 is a block diagram illustrating a configuration example of the vehicle display system according to the first embodiment.

  As shown in FIGS. 1 to 3, the vehicle display system 1 includes a rear camera 110, a right rear camera (side rear camera) 120, a left rear camera (side rear camera) 130, and a rear view monitor (display device). 140, a right side view monitor (side rear confirmation device) 150, a left side view monitor (side rear confirmation device) 160, and the vehicle display control device 10.

  The rear camera 110 is disposed behind the vehicle 100 so as to face the rear, and images the rear of the vehicle 100. The rear camera 110 has an angle of view in the horizontal direction of, for example, 90 to 180 °, and an angle of view in the vertical direction of, for example, 45 to 90 °. For example, the rear camera 110 captures first video data (rear video data) 110A as shown in FIG. FIG. 4 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the first embodiment. The rear camera 110 can shoot an image in a wider range than the range displayed on the rear view monitor 140, but the rear view monitor 140 is used to cut out a range in which the driver of the vehicle 100 can properly recognize the rear. 140. The rear camera 110 outputs the captured first video data 110 </ b> A to the rear video data acquisition unit 42 of the video data acquisition unit 40 of the vehicle display control device 10.

  The right rear camera 120 is disposed to face the right side of the vehicle 100 and photographs the right side of the vehicle 100. The right rear camera 120 captures a confirmation range by the right side view monitor 150. The right rear camera 120 has a horizontal angle of view of, for example, 15 to 45 °, and a vertical angle of view of, for example, 15 to 45 °. The right rear camera 120 is adjustable in angle. The right rear camera 120 outputs the captured video (side rear video data) to the side rear video data acquisition unit 41 of the video data acquisition unit 40 of the vehicle display control device 10.

  The left rear camera 130 is disposed to face the left side of the vehicle 100 and photographs the left side of the vehicle 100. The left rear camera 130 captures a confirmation range by the left side view monitor 160. The left rear camera 130 has a horizontal angle of view of, for example, 15 to 45 °, and a vertical angle of view of, for example, 15 to 45 °. The left rear camera 130 is adjustable in angle. The left rear camera 130 outputs the captured video (side rear video data) to the side rear video data acquisition unit 41 of the video data acquisition unit 40 of the vehicle display control device 10.

  The rear view monitor 140 is an electronic room mirror as an example. When the rear view monitor 140 is used as an electronic room mirror, it does not matter whether there is a half mirror for confirming the rear by optical reflection. The rear view monitor 140 is a display including, for example, a liquid crystal display (LCD) or an organic EL-Organic Electro-Luminescence (EL) display. The rear view monitor 140 displays a rear image of the vehicle 100 based on the video signal output from the display control unit 70 of the vehicle display control device 10. Specifically, the rear view monitor 140 displays a rear image as shown in FIG. FIG. 5 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. The rear view monitor 140 is disposed at a position that is easily visible to the driver. In the present embodiment, the rear view monitor 140 is disposed at the center upper portion of the windshield 101 in the vehicle width direction. Alternatively, the rear view monitor 140 may be embedded in the dashboard 102 or the head liner.

  The size and shape of the rear view monitor 140 are not limited. For example, the rear view monitor 140 may be the same size and shape as a conventional optical room mirror. Alternatively, for example, the rear view monitor 140 may be wider in the vehicle width direction than a conventional optical rearview mirror. Alternatively, for example, the rear view monitor 140 may be wider in the vertical direction than a conventional optical room mirror.

  The right side view monitor 150 is a display including a liquid crystal display or an organic EL display, for example. The right side view monitor 150 displays a right rear video of the vehicle 100 based on the video signal output from the display control unit 70 of the vehicle display control device 10. Specifically, the right side view monitor 150 displays a right rear video as shown in FIG. FIG. 6 is a diagram illustrating an example of an image displayed on the right side view monitor of the vehicle display system according to the first embodiment. On the right side view monitor 150, the vehicle body 100R on the right side of the vehicle 100 is reflected. The right side view monitor 150 is disposed at a position that is easily visible to the driver. In the present embodiment, the right side view monitor 150 is disposed on the right side of the dashboard 102 in the vehicle width direction.

  The left side view monitor 160 is a display including a liquid crystal display or an organic EL display, for example. The left side view monitor 160 displays a left rear video of the vehicle 100 based on the video signal output from the display control unit 70 of the vehicle display control device 10. For example, the left side view monitor 160 displays a left rear image as shown in FIG. FIG. 7 is a diagram illustrating an example of an image displayed on the left side view monitor of the vehicle display system according to the first embodiment. On the left side view monitor 160, the vehicle body 100L on the left side of the vehicle 100 is reflected. The left side view monitor 160 is disposed at a position that is easily visible to the driver. In the present embodiment, the left side view monitor 160 is disposed on the left side of the dashboard 102 in the vehicle width direction.

  Returning to FIG. 3, the vehicle display control apparatus 10 includes a storage unit 20 and a control unit 30.

  The storage unit 20 stores data and various processing results required for various processes in the vehicle display control apparatus 10. The storage unit 20 is, for example, a semiconductor memory device such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory (Flash Memory), or a storage device such as a hard disk, an optical disk, or an external storage device via a network. It is. Alternatively, an external storage device that is wirelessly connected via a communication device (not shown) may be used.

  The control unit 30 is an arithmetic processing unit configured with, for example, a CPU (Central Processing Unit). The control unit 30 includes a video data acquisition unit 40, a video processing unit 50, a traveling state information acquisition unit 60, and a display control unit 70. The control unit 30 executes instructions included in the program stored in the storage unit 20.

  The video data acquisition unit 40 acquires a video obtained by photographing the rear and side rear of the vehicle 100. The video data acquired by the video data acquisition unit 40 is, for example, video data in which images of 60 frames per second are continuous. The video data acquisition unit 40 includes a side rear video data acquisition unit 41 and a rear video data acquisition unit 42. The side rear video data acquisition unit 41 acquires the second video data output from the right rear camera 120 and the left rear camera 130. The side rear video data acquisition unit 41 outputs the acquired second video data to the cutout unit 51. The rear video data acquisition unit 42 acquires the first video data 110 </ b> A output from the rear camera 110. The rear video data acquisition unit 42 outputs the acquired first video data 110 </ b> A to the cutout unit 51.

  The cutout unit 51 cuts out the rear video data 110B to be displayed on the rear view monitor 140 from the first video data 110A. The cutout unit 51 cuts out a part of the first video data 110A from the first video data 110A. Which range of the first video data 110A is to be cut out is registered and stored in advance. In the present embodiment, the central portion of the first video data 110A is cut out. The cutout unit 51 outputs the cut out rear video data 110 </ b> B to the video composition unit 52 and the display control unit 70.

  The cutout unit 51 cuts out the right rear video data 120B and the left rear video data 130B to be displayed on the right side view monitor 150 and the left side view monitor 160 from the second video data. The cutout unit 51 cuts out a part of the second video data from the second video data. Which range of the second video data is to be cut out is registered and stored in advance. The cutout unit 51 outputs the cut out right rear video data 120B and the left rear video data 130B to the video composition unit 52 and the display control unit 70. The rear video data 110B, the right rear video data 120B, and the left rear video data 130B cut out by the cutout unit 51 are synchronized.

  The video composition unit 52 generates the rear video data 110C by compositing the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B according to the driving situation acquired by the driving situation information acquisition unit 60. . In the present embodiment, when the traveling state information acquisition unit 60 acquires information indicating that the vehicle 100 moves backward, the video composition unit 52 has the right rear video data 120B and the left rear video on the left and right upper sides of the rear video data 110B. The rear video data 110C obtained by combining the data 130B is generated. For example, the video composition unit 52 generates the synthesized rear video data 110C as shown in FIG. FIG. 8 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. In the present embodiment, the size of the right rear video data 120B and the left rear video data 130B in the synthesized rear video data 110C is about half of the upper size in the vertical size of the display surface of the rear view monitor 140. . The size of the right rear video data 120B and the left rear video data 130B in the synthesized rear video data 110C is about one third of the horizontal size of the display surface of the rear view monitor 140. The video composition unit 52 outputs the synthesized rear video data 110 </ b> C to the display control unit 70.

  Here, in the rear video data 110B, the range in which the driver needs to confirm safety while driving is the range of the center portion and the left and right lower portions of the rear video data 110B. The center portion of the rear video data 110B includes a vanishing point when the travel path is straight ahead. In other words, the upper left and right range of the rear video data 110B is less necessary for the driver to confirm safety during driving. Therefore, the video composition unit 52 synthesizes the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B. In the present embodiment, the size of the right rear video data 120B and the left rear video data 130B in the synthesized rear video data 110C is about one half above the vertical size of the display surface of the rear view monitor 140, and the range in which the images overlap Is made smaller. In the present embodiment, the size of the right rear video data 120B and the left rear video data 130B in the synthesized rear video data 110C is about one third of the horizontal size of the display surface of the rear view monitor 140. The overlapping range is made smaller. Further, the right rear video data 120B and the left rear video data 130B may be surrounded by a frame line or the like so that the boundary between the rear video data 110B, the right rear video data 120B, and the left rear video data 130B is clear. It is effective.

  The traveling state information acquisition unit 60 is connected to a CAN (Controller Area Network) provided in the vehicle 100 and acquires OBD (On Board Diagnostics) II data and the like, thereby acquiring various traveling state information in the vehicle 100. The traveling state information acquisition unit 60 acquires information indicating that the vehicle 100 moves backward as the traveling state information of the vehicle 100. More specifically, the traveling state information acquisition unit 60 acquires shift position information or traveling direction information, for example. The traveling state information acquisition unit 60 outputs the acquired traveling state information to the video composition unit 52.

  The display control unit 70 outputs the rear video data 110B or the rear video data 110C synthesized by the video synthesis unit 52 to the rear view monitor 140 every frame or every predetermined frame.

  The display control unit 70 causes the right side view monitor 150 to display the right rear video data 120B every frame or every predetermined frame. In other words, the display control unit 70 causes the right side view monitor 150 to display the right rear video data 120B based on the second video data captured by the right rear camera 120.

  The display control unit 70 displays the left rear video data 130B on the left side view monitor 160 every frame or every predetermined frame. In other words, the display control unit 70 causes the left side view monitor 160 to display the left rear video data 130 </ b> B based on the second video data captured by the left rear camera 130. The display control unit 70 is displayed on the rear video data 110B or the synthesized rear video data 110C displayed on the rear view monitor 140, the right rear video data 120B displayed on the right side view monitor 150, and the left side view monitor 160. The display is controlled so as to be synchronized with the left rear video data 130B.

  Next, information processing in the control unit 30 will be described with reference to FIG. FIG. 9 is a flowchart showing the flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the first embodiment.

  As a premise in the processing of FIG. 9, while the vehicle 100 is operating, the rear video data 110B is displayed on the rear view monitor 140, the right rear video data 120B is displayed on the right side view monitor 150, and the left video is displayed on the left side view monitor 160. This is a state in which the rear video data 130B is displayed. Further, in such a state, the control unit 30 continues to acquire the traveling state by the traveling state information acquisition unit 60. More specifically, the control unit 30 constantly monitors whether or not traveling state information including shift position information or traveling direction information is generated by the traveling state information acquisition unit 60, for example.

  The control unit 30 determines whether or not there is a reverse trigger (step S11). The reverse trigger means that, for example, the shift position is “reverse”. Alternatively, the reverse trigger means that the traveling direction of the vehicle 100 is the rear of the vehicle 100 in the front-rear direction. The control unit 30 determines the presence or absence of a reverse trigger based on the traveling state information acquired by the traveling state information acquisition unit 60. When it is determined that there is no reverse trigger (No in step S11), the control unit 30 executes the process of step S11 again. If it is determined that there is a reverse trigger (Yes in step S11), the control unit 30 proceeds to step S12.

  If it is determined in step S11 that there is a backward trigger, the control unit 30 generates the synthesized rear video data 110C (step S12). More specifically, the control unit 30 causes the cutout unit 51 to cut out the rear video data 110B from the first video data 110A. Then, the control unit 30 causes the video composition unit 52 to generate the rear video data 110C obtained by combining the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B.

  The control unit 30 displays the synthesized rear video data 110C generated in step S12 (step S13). More specifically, the control unit 30 causes the display control unit 70 to display the normal rear video data 110B or the synthesized rear video data 110C on the rear view monitor 140.

  The traveling state information acquisition unit 60 continues to acquire the traveling state even after it is determined in step S11 that there is a reverse trigger. More specifically, the control unit 30 continues to acquire the traveling state by the traveling state information acquisition unit 60.

  In the period in which the synthesized rear video data 110C is displayed in step S13, the control unit 30 determines the end of the reverse based on the traveling state information acquired by the traveling state information acquiring unit 60 (step S14). More specifically, the control unit 30 determines the release of the reverse trigger based on the traveling state information acquired by the traveling state information acquisition unit 60. When it is determined that the reverse trigger is not released (No in step S14), the control unit 30 continues to display the synthesized rear video data 110C. When it is determined that the reverse trigger is released (Yes in step S14), the control unit 30 generates the rear video data 110B (step S15) and displays the rear video data 110B (step S16). ). That is, in steps S15 and S16, display of normal rear video data B is started and continued as before the backward trigger is detected in step S11.

  The control unit 30 repeats the above process every time a reverse trigger is detected.

  A specific example of information processing in the control unit 30 will be described with reference to FIGS. 10 to 14. FIG. 10 is a diagram illustrating another example of the video data captured by the rear camera of the vehicle display system according to the first embodiment. FIG. 11 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 12 is a diagram illustrating another example of an image displayed on the right side view monitor of the vehicle display system according to the first embodiment. FIG. 13 is a diagram illustrating another example of an image displayed on the left side view monitor of the vehicle display system according to the first embodiment. FIG. 14 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. In the vehicle 100, the shift position “reverse” is selected. In the first video data 110 </ b> A shown in FIG. 10, another vehicle 201 parked behind the vehicle 100 is shown. In step S11, the control unit 30 determines that there is a reverse trigger (Yes in step S11). In step S12, the control unit 30 causes the cutout unit 51 to cut out the rear video data 110B shown in FIG. 11 from the first video data 110A shown in FIG. Then, the control unit 30 synthesizes the right rear video data 120B shown in FIG. 12 on the upper right side of the rear video data 110B and the left rear video data 130B shown in FIG. Thus, the synthesized rear video data 110C is generated. In step S <b> 13, the control unit 30 causes the display control unit 70 to display the synthesized rear video data 110 </ b> C shown in FIG. 14 on the display surface of the rear view monitor 140.

  In this way, the vehicle display system 1 displays the synthesized rear video data 110C on the display surface of the rear view monitor 140 in accordance with the driving situation acquired by the driving condition information acquisition unit 60.

  As described above, in the present embodiment, the synthesized rear image data 110C is displayed on the display surface of the rear view monitor 140 in accordance with the traveling situation acquired by the traveling situation information acquisition unit 60. In the present embodiment, when the vehicle 100 moves backward, the rear video data 110C obtained by combining the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B is displayed on the display surface of the rear view monitor 140. Accordingly, in the present embodiment, the rear side of the vehicle 100 can be confirmed along with the rear side of the vehicle 100 on the display surface of the rear view monitor 140 when the vehicle 100 moves backward. For this reason, this embodiment can suppress a driver | operator's eyes | visual_axis movement. More specifically, in the present embodiment, it is possible to confirm the rear side in the roadside direction without moving the line of sight from the rear view monitor 140 and visually recognizing the right side view monitor 150 and the left side view monitor 160. This embodiment can reduce the time required for confirmation of the driver's rear and side rear. As described above, the vehicle display system 1 can make it possible to check the vicinity of the appropriate vehicle 100.

  According to the present embodiment, when the vehicle 100 moves backward, the synthesized rear video data 110 </ b> C is displayed on the display surface of the rear view monitor 140. For this reason, according to the present embodiment, the rear side of the vehicle 100 can be displayed on the display surface of the rear view monitor 140 together with the rear side of the vehicle 100 automatically regardless of the operation by the driver. As described above, the vehicle display system 1 can make it possible to check the vicinity of the appropriate vehicle 100.

  According to the present embodiment, when the vehicle 100 moves backward, when the predetermined condition is satisfied, the synthesized rear image data 110C is displayed on the display surface of the rear view monitor 140. In other words, according to the present embodiment, when the predetermined condition is satisfied, the synthesized rear video data 110C is displayed, and in the other cases, the rear video data 110B is displayed. For this reason, this embodiment can display an image with an appropriate amount of information at the timing required by the driver when the vehicle 100 moves backward.

  According to the present embodiment, the video composition unit 52 synthesizes the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B. In other words, according to the present embodiment, the video composition unit 52 reduces the range below the vanishing point of the rear video data 110B so that the right rear video data 120B and the left rear video data 130B overlap. In other words, in the upper left and right of the rear video data 110B, the priority of the backward confirmation at the time of backward movement is low, and the confirmation by the right rear video data 120B and the left rear video data 130B is more appropriate. For this reason, this embodiment can confirm the back of the range where the necessity of safety confirmation during driving is high for the driver as in the case of the conventional optical room mirror, regardless of the traveling state.

[Second Embodiment]
The vehicle display system 1 according to the present embodiment will be described with reference to FIGS. 15 to 17. FIG. 15 is a flowchart showing a flow of processing in the control unit of the vehicle display control device of the vehicle display system according to the second embodiment. FIG. 16 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the second embodiment. FIG. 17 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the second embodiment. The vehicle display system 1 according to the present embodiment has the same basic configuration as the vehicle display system 1 of the first embodiment. In the following description, the same components as those of the vehicle display system 1 are denoted by the same reference numerals or corresponding reference numerals, and detailed description thereof is omitted. The vehicle display system 1 according to the present embodiment is different from the vehicle display system 1 according to the first embodiment in information processing in the cutout unit 51 and the control unit 30.

  The cutout unit 51 sets the cutout range from the first video data 110A to be lower than the cutout range of the normal rear video data 110B according to the traveling state. More specifically, when the display control unit 70 displays the rear video data 110C synthesized by the video synthesis unit 52, the cutout unit 51 cuts out the lower part than when displaying the normal rear video data 110B that is not synthesized. In this manner, the cut-out range from the first video data 110A is set. For example, the cutout range is set so as to include a predetermined pixel lower than the cutout range when displaying the normal uncombined rear video data 110B. In other words, when the display control unit 70 displays the rear video data 110C synthesized by the video synthesis unit 52, the cutout unit 51 sets a position closer to the vehicle 100 to be included in the cutout range. The cutout unit 51 outputs the cut out rear video data 110B2 to the video composition unit 52 and the display control unit 70.

  Next, information processing in the control unit 30 will be described with reference to FIG. The processes in step S21 and steps S24 to S27 in the flowchart shown in FIG. 15 are the same as the processes in steps S11 and S13 to S16 in the flowchart shown in FIG.

  The control unit 30 shifts the cutout range downward to cut out the rear video data 110B2 (Step S22).

  The control unit 30 generates the synthesized rear video data 110C (step S23). More specifically, the control unit 30 generates the rear video data 110C obtained by combining the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B2 cut out by the cutout unit 51.

  A specific example of information processing in the control unit 30 will be described with reference to FIGS. 16 and 17. In the vehicle 100, the shift position “reverse” is selected. In the first video data 110 </ b> A shown in FIG. 16, the other vehicle 201 parked behind the vehicle 100 is shown. In step S21, the control unit 30 determines that there is a reverse trigger (Yes in step S21). In step S22, the control unit 30 causes the cutout unit 51 to shift the cutout range of the rear video data 110B downward to cut out the rear video data 110B2 from the first video data 110A shown in FIG. . In step S23, the control unit 30 causes the video composition unit 52 to generate the rear video data 110C obtained by combining the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B2. In step S24, the control unit 30 causes the display control unit 70 to display the synthesized rear video data 110C shown in FIG. 17 on the display surface of the rear view monitor 140.

  In this way, the vehicle display system 1 cuts out the lower part of the normal rear image data 110B that has not been combined, and rearranges the combined rear image data 110C in the rear view according to the driving state acquired by the driving state information acquisition unit 60. It is displayed on the display surface of the monitor 140.

  As described above, in the present embodiment, when the vehicle 100 moves backward, the right rear video data 120B and the left rear video data 130B are synthesized on the left and right upper sides of the rear video data 110B2 that is extracted by shifting the cutout range downward. The synthesized rear video data 110C is displayed on the display surface of the rear view monitor 140. Accordingly, in the present embodiment, the rear side including the position closer to the vehicle 100 can be confirmed on the display surface of the rear view monitor 140. As described above, the vehicle display system 1 can make it possible to check the vicinity of the appropriate vehicle 100.

[Third embodiment]
A vehicle display system 1A according to the present embodiment will be described with reference to FIGS. FIG. 18 is a block diagram illustrating a configuration example of the vehicle display system according to the third embodiment. FIG. 19 is a flowchart illustrating a process flow in the control unit of the vehicle display control device of the vehicle display system according to the third embodiment. FIG. 20 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the third embodiment. FIG. 21 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the third embodiment. The vehicle display system 1A of the present embodiment is different from the vehicle display system 1 of the first embodiment in that it includes a detection unit 80 and a recognition dictionary storage unit 300 and information processing in the control unit 30A.

  The recognition dictionary storage unit 300 stores, for example, a recognition dictionary that can collate patterns such as shapes, sizes, and colors of obstacles including vehicles, people, walls, curbs, plants, and the like in each direction. The recognition dictionary storage unit 300 is, for example, a semiconductor memory device such as a RAM, a ROM, or a flash memory, or a storage device such as a hard disk, an optical disk, or an external storage device via a network.

  The detection unit 80 detects an obstacle on the left and right sides of the rear video data 110B. The left and right sides of the rear video data 110 </ b> B are ranges that overlap with the confirmation range by the right side view monitor 150 or the left side view monitor 160. For example, the left and right sides of the rear video data 110B are about one third of the left and right in the horizontal size of the rear video data 110B. The detection unit 80 performs obstacle recognition processing on the left and right sides of the rear video data 110B to detect obstacles. More specifically, the detection unit 80 performs pattern matching using the recognition dictionary stored in the recognition dictionary storage unit 300 on the left and right sides of the rear video data 110B, and detects the presence of an obstacle. The detection unit 80 tracks the detected obstacle by image processing. The detection unit 80 outputs the detection result to the video composition unit 52A.

  When the detection unit 80 detects an obstacle, the video synthesis unit 52A has at least one of the right rear video data 120B and the left rear video data 130B corresponding to the direction in which the obstacle is detected in the synthesized rear video data 110C. Enlarge the display. More specifically, when the detection unit 80 detects an obstacle on the left side of the rear video data 110B, the video synthesis unit 52A detects the left rear video in the synthesis range of the left rear video data 130B of the synthesized rear video data 110C. The data 130B is expanded. When the detection unit 80 detects an obstacle on the right side of the rear video data 110B, the video synthesis unit 52A expands the right rear video data 120B in the synthesis range of the right rear video data 120B of the synthesized rear video data 110C. To do. In the present embodiment, the right rear video data 120B and the left rear video data 130B corresponding to the direction in which the obstacle is detected are enlarged on the basis of the lower side on the vehicle 100 side. The video composition unit 52A outputs the synthesized rear video data 110C2 in which the direction in which the obstacle is detected is enlarged to the display control unit 70.

  Information processing in the control unit 30A will be described. The processes in steps S31 to S33 and steps S36 to S38 in the flowchart shown in FIG. 19 are the same as the processes in steps S11 to S13 and steps S14 to S16 in the flowchart shown in FIG.

  The control unit 30A determines whether an obstacle is detected on the left and right sides of the rear video data 110B (step S34). More specifically, the control unit 30A determines whether the detection unit 80 has detected an obstacle on the left and right sides of the rear video data 110B. When the detection unit 80 determines that no obstacle is detected on the left and right sides of the rear video data 110B (No in step S34), the control unit 30A proceeds to step S36. When it is determined by the detection unit 80 that the detection unit 80 has detected an obstacle on the left and right sides of the rear video data 110B (Yes in step S34), the control unit 30A proceeds to step S35.

  The control unit 30A enlarges the displayed video in the combined range of at least one of the right rear video data 120B and the left rear video data 130B in the detection direction (step S35). More specifically, the control unit 30A generates the right rear video in the synthesis range of either the right rear video data 120B or the left rear video data 130B generated in step S32 and corresponding to the detection direction of the synthesized rear video data 110C. The displayed video of the data 120B or the left rear video data 130B is enlarged to generate the synthesized rear video data 110C2. In the process of enlarging the displayed video, the cutout range in the cutout unit 51 is narrowed and cut out, and the right rear video data 120B or the left rear video data 130B cut out narrowly is enlarged and displayed.

  A specific example of information processing in the control unit 30A will be described with reference to FIGS. In the vehicle 100, the shift position “reverse” is selected. In the first video data 110A shown in FIG. 20, a curbstone 202 is shown on the left side. In step S31, the control unit 30A determines that there is a reverse trigger (Yes in step S31). In step S32, the control unit 30A causes the cutout unit 51 to cut out the rear video data 110B from the first video data 110A illustrated in FIG. Then, the control unit 30A causes the video composition unit 52A to generate the rear video data 110C obtained by combining the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B. Then, the control unit 30A determines in step S34 that the detection unit 80 has detected an obstacle on the left and right sides of the rear video data 110B (Yes in step S34). Then, in step S35, the control unit 30A enlarges the left rear video data 130B in the synthesis range of the left rear video data 130B corresponding to the left side that is the obstacle detection direction, and synthesizes the left rear video data 130B. The rear video data 110C2 thus generated is generated. Then, the control unit 30A causes the display control unit 70 to display the rear video data 110C2 obtained by combining the enlarged left rear video data 130B2 illustrated in FIG. 21 on the display surface of the rear view monitor 140.

  Thus, when an obstacle is detected on the left and right sides of the rear video data 110B, the vehicle display system 1A has the right rear video data 120B and the left rear video data 130B corresponding to the direction in which the obstacle is detected. Is displayed on the display surface of the rear view monitor 140.

  As described above, in this embodiment, when an obstacle is detected on the left and right sides of the rear video data 110B, the right rear video data 120B and the left rear video data 130B corresponding to the direction in which the obstacle is detected are enlarged. The synthesized rear video data 110C2 is displayed on the display surface of the rear view monitor 140. For this reason, in the present embodiment, obstacles on the left and right sides of the vehicle 100 can be easily confirmed on the display surface of the rear view monitor 140. As described above, the present embodiment can make it possible to confirm the vicinity of the appropriate vehicle 100.

[Fourth embodiment]
The vehicle display system 1 according to the present embodiment will be described with reference to FIG. FIG. 22 is a flowchart showing a flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the fourth embodiment. The vehicle display system 1 of the present embodiment is different from the vehicle display system 1 of the first embodiment in the information processing in the control unit 30.

  The travel status information acquisition unit 60 acquires information related to the travel speed of the vehicle 100 as information indicating the travel status of the vehicle 100.

  When the driving condition information acquisition unit 60 acquires information indicating that the vehicle 100 is in a low-speed driving condition, the video composition unit 52 includes the right rear video data 120B and the left rear video on the left and right upper sides of the rear video data 110B. The data 130B is synthesized. The low-speed traveling state refers to a state in which the traveling state acquired by the traveling state information acquisition unit 60 is determined to be, for example, that the state in which the traveling speed of the vehicle 100 is less than a predetermined speed continues. Alternatively, the low-speed traveling state may be a state in which the traveling path of the vehicle 100 is determined to be an urban area, a residential area, a shopping area, or a road with many pedestrians based on navigation information or information acquired by an external server. . Alternatively, the low-speed traveling state may be a state in which it is determined that the vehicle 100 is traveling on a road whose road width is less than a predetermined width based on navigation information or information acquired by an external server. Alternatively, the low-speed traveling state may be a state in which it is determined that the vehicle 100 is traveling on a single lane road based on navigation information or information acquired by an external server.

  Information processing in the control unit 30 will be described. The processes in step S42, step S43, step S45, and step S46 in the flowchart shown in FIG. 22 are the same as the processes in step S12, step S13, step S15, and step S16 in the flowchart shown in FIG.

  The control part 30 determines whether it is a low-speed driving | running | working condition (step S41). More specifically, the control unit 30 determines whether or not the traveling state acquired by the traveling state information acquiring unit 60 indicates that the vehicle 100 is in a low-speed traveling state. When it determines with the control part 30 not being a low-speed driving | running | working condition (it is No at step S41), it performs the process of step S41 again. When it determines with it being a low speed driving | running | working condition (it is Yes at step S41), the control part 30 progresses to step S42.

  The traveling state information acquisition unit 60 continues to acquire the traveling state even after it is determined in step S41 that the traveling state information is a low speed traveling state. More specifically, the control unit 30 continues to acquire the traveling state by the traveling state information acquisition unit 60.

  In step S43, during the period in which the synthesized rear video data 110C is displayed, the control unit 30 determines the end of the low-speed traveling state based on the traveling state information acquired by the traveling state information acquisition unit 60 (step S44). ). When it is determined that the low-speed traveling state has not ended (No in Step S44), the control unit 30 continues to display the synthesized rear video data 110C. When it is determined that the low-speed driving situation has ended (Yes in Step S44), the control unit 30 generates the rear video data 110B (Step S45) and displays the rear video data 110B (Step S46). ). That is, in steps S45 and S46, the display of the normal rear video data 110B is started and continued as before the step S41 is determined to be the low-speed traveling state.

  Thus, the vehicular display system 1 displays the synthesized rear video data 110C on the display surface of the rear view monitor 140 when the vehicle is in a low-speed driving situation.

  As described above, in this embodiment, when the vehicle is traveling at a low speed, the synthesized rear image data 110C is displayed on the display surface of the rear view monitor 140. Accordingly, in the present embodiment, the rear side of the vehicle 100 can be confirmed on the display surface of the rear view monitor 140 when the vehicle is traveling at a low speed. For this reason, this embodiment can suppress a driver | operator's eyes | visual_axis movement. This embodiment can reduce the time required for confirmation of the driver's rear and side rear. As described above, the vehicle display system 1 can make it possible to check the vicinity of the appropriate vehicle 100.

  It is known that the rear view monitor 140 takes a long visual confirmation time when traveling at a low speed. According to the present embodiment, when the driver wants to check the roadside side rear side of the vehicle 100 in a low-speed driving situation, the rear side of the vehicle 100 is checked on the display surface of the rear view monitor 140 together with the rear side of the vehicle 100. be able to. Thus, this embodiment can provide suitable information to the driver via the display surface of the rear view monitor 140 at a timing required by the driver.

[Fifth embodiment]
The vehicle display system 1 according to the present embodiment will be described with reference to FIGS. 23 to 25. FIG. 23 is a flowchart illustrating a process flow in the control unit of the vehicle display control device of the vehicle display system according to the fifth embodiment. FIG. 24 is a diagram illustrating an example of video data captured by the rear camera of the vehicle display system according to the fifth embodiment. FIG. 25 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the fifth embodiment. The vehicle display system 1 of the present embodiment is different from the vehicle display system 1 of the first embodiment in the information processing in the control unit 30.

  The travel status information acquisition unit 60 acquires information related to the travel path of the vehicle 100 as information indicating the travel status of the vehicle 100. More specifically, the traveling state information acquisition unit 60 acquires information related to the traveling path from navigation information or an external server. In the present embodiment, the traveling state information acquisition unit 60 acquires the number of lanes on the road on which the vehicle 100 is traveling.

  When the road information acquired by the traveling state information acquisition unit 60 indicates a one-lane road, the video composition unit 52 is located on the right side of the left side of the rear video data 110B and on the right side of the right side. The video data 120B or the left rear video data 130B is synthesized. More specifically, when the roadside direction is the left side, the video composition unit 52 synthesizes the left rear video data 130B on the upper left side of the rear video data 110B. When the roadside direction is the right side, the video synthesis unit 52 synthesizes the right rear video data 120B on the upper right side of the rear video data 110B.

  Information processing in the control unit 30 will be described. The processing in step S53, step S55, and step S56 in the flowchart shown in FIG. 23 is the same as the processing in step S13, step S15, and step S16 in the flowchart shown in FIG.

  The control unit 30 determines whether or not the traveling road is one lane on one side (step S51). More specifically, the control unit 30 determines whether or not the traveling state acquired by the traveling state information acquiring unit 60 indicates a one-lane road in which the traveling path of the vehicle 100 is. When it is determined that the traveling road is not one lane on one side (No in step S51), the control unit 30 executes the process of step S51 again. If the control unit 30 determines that the travel path is a single lane on one side (Yes in step S51), the control unit 30 proceeds to step S52.

  The control unit 30 generates the rear video data 110C obtained by combining the right rear video data 120B or the left rear video data 130B corresponding to the roadside direction (step S52). More specifically, the control unit 30 causes the video composition unit 52 to generate the rear video data 110C by combining the right rear video data 120B or the left rear video data 130B on the left and right upper sides corresponding to the roadside direction of the rear video data 110B. .

  The traveling state information acquisition unit 60 continues to acquire the traveling state even after it is determined in step S51 that the traveling road is one lane on one side. More specifically, the control unit 30 continues to acquire the traveling state by the traveling state information acquisition unit 60.

  In step S53, during the period in which the synthesized rear video data 110C is displayed, the control unit 30 determines the end of the one-lane road based on the driving state information acquired by the driving state information acquiring unit 60 ( Step S54). When it is determined that the one-lane road is not completed (No in step S54), the control unit 30 continues to display the synthesized rear video data 110C. When it is determined that the one-lane road has ended (Yes in step S54), the control unit 30 generates the rear video data 110B (step S55) and displays the rear video data 110B (step S55). Step S56). That is, in steps S55 and S56, the display of the normal rear video data 110B is started and continued as before the road is determined to be one lane in step S51.

  A specific example of information processing in the control unit 30 will be described with reference to FIGS. 24 and 25. The first video data 110A shown in FIG. 24 is a video when the vehicle 100 is traveling on a one-lane road. In step S51, the control unit 30 determines that the travel path is one lane (Yes in step S51). In step S52, the control unit 30 generates the rear video data 110C obtained by combining the left rear video data 130B with the upper left corresponding to the left side in the roadside direction of the rear video data 110B. Then, the control unit 30 displays the rear video data 110C obtained by combining the left rear video data 130B shown in FIG. 25 on the display surface of the rear view monitor 140.

  In this way, when the vehicle display system 1 is traveling on a one-lane road, the right-side rear video data 120B or the left-side rear corresponding to the left-right direction corresponding to the road-side direction is provided at the upper left and right of the rear video data 110B. The video data 130B is synthesized.

  As described above, in the present embodiment, when traveling on a one-lane road, either the right rear video data 120B or the left rear video data corresponding to the road side direction is provided at the upper left and right of the rear video data 110B. The rear video data 110C obtained by combining 130B is displayed on the display surface of the rear view monitor 140. Accordingly, in the present embodiment, when traveling on a one-lane road, the rear side of the vehicle 100 can be confirmed on the display surface of the rear view monitor 140 along with the rear of the vehicle 100. For this reason, this embodiment can suppress a driver | operator's eyes | visual_axis movement. This embodiment can reduce the time required for confirmation of the driver's rear and side rear. As described above, the vehicle display system 1 can make it possible to check the vicinity of the appropriate vehicle 100.

[Sixth embodiment]
The vehicle display system 1 according to the present embodiment will be described with reference to FIGS. 26 to 28. FIG. 26 is a flowchart showing the flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the sixth embodiment. FIG. 27 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the sixth embodiment. FIG. 28 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the sixth embodiment. The vehicle display system 1 of the present embodiment is different from the vehicle display system 1 of the first embodiment in the information processing in the control unit 30.

  The travel status information acquisition unit 60 acquires information related to the travel path of the vehicle 100 as information indicating the travel status of the vehicle 100. More specifically, the traveling state information acquisition unit 60 acquires information that can determine whether the vehicle 100 is traveling on a low-speed road based on, for example, navigation information or information acquired by an external server. . A road that travels at a low speed refers to a road that has many urban areas, residential areas, shopping areas, and pedestrians. Alternatively, the road traveling at a low speed may be a road having a road width less than a predetermined width. Alternatively, it may be a single lane road. Alternatively, it may be a road that is determined to be a one-lane road.

  When the driving condition information acquisition unit 60 acquires information indicating that the vehicle 100 is traveling on a road traveling at a low speed, the video composition unit 52 displays the right rear video data on the left and right upper sides of the rear video data 110B. 120B and left rear video data 130B are synthesized. Furthermore, when the road information acquired by the traveling state information acquisition unit 60 indicates a one-lane road, the video composition unit 52 is either the right rear video data 120B or the left rear video corresponding to the road side direction. The data 130B is enlarged and combined. More specifically, when the roadside direction is the left side, the video composition unit 52 synthesizes the left rear video data 130B on the upper left side of the rear video data 110B. When the roadside direction is the right side, the video synthesis unit 52 synthesizes the right rear video data 120B on the upper right side of the rear video data 110B.

  Information processing in the control unit 30 will be described. The processing in step S62, step S63, step S68, and step S69 in the flowchart shown in FIG. 26 is the same as the processing in step S12, step S13, step S15, and step S16 in the flowchart shown in FIG. The processing in step S64 and step S66 in the flowchart shown in FIG. 26 is the same as the processing in step S51 and step S54 in the flowchart shown in FIG.

  The control unit 30 determines whether or not the vehicle is traveling on a road that travels at a low speed (step S61). More specifically, the control unit 30 determines whether or not the traveling state acquired by the traveling state information acquiring unit 60 indicates that the vehicle 100 is traveling on a road on which low speed traveling is performed. When it determines with the control part 30 not driving | running | working the road which carries out low speed driving | running (it is No at step S61), it performs the process of step S61 again. When it is determined that the control unit 30 is traveling on a road that travels at a low speed (Yes in step S61), the control unit 30 proceeds to step S62.

  If it is determined in step S64 that the road is a single lane on one side, the control unit 30 displays an image to be displayed in either the right rear video data 120B or the left rear video data 130B corresponding to the roadside direction. Enlarge (step S65). More specifically, the control unit 30 in the video composition unit 52 generates the right rear video data 120B or the left rear video data 130B corresponding to the roadside direction of the composite rear video data 110C generated in step S62. The displayed video of the right rear video data 120B or the left rear video data 130B is enlarged to generate synthesized rear video data 110C2. In the process of enlarging the displayed video, the cutout range in the cutout unit 51 is narrowed and cut out, and the right rear video data 120B or the left rear video data 130B cut out narrowly is enlarged and displayed.

  A specific example of information processing in the control unit 30 will be described. If it is determined in step S61 that the vehicle is not traveling on a low-speed road (No in step S61), the control unit 30 continues to generate and display the normal rear video data 110B. If the control unit 30 determines in step S61 that the vehicle is traveling on a low-speed road (Yes in step S61), the control unit 30 generates the synthesized rear video data 110C in step S62. More specifically, the control unit 30 generates rear video data 110C obtained by combining the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B shown in FIG. Furthermore, when the control unit 30 determines in step S64 that the travel road is a single lane (Yes in step S64), in step S65, either the left or right right rear video data 120B corresponding to the road side direction or the left side In the rear video data 130B, the synthesized rear video data 110C2 is generated by enlarging the displayed video. More specifically, the control unit 30 generates the rear video data 110C2 including the left rear video data 130B2 obtained by enlarging the displayed video in the left rear video data 130B corresponding to the left side that is the roadside direction illustrated in FIG. . Then, the control unit 30 displays the normal rear video data 110B, the synthesized rear video data 110C, or the synthesized rear video data 110C2 on the display surface of the rear view monitor 140.

  Thus, the vehicle display system 1 combines the right rear video data 120B and the left rear video data 130B on the left and right upper sides of the rear video data 110B when the vehicle 100 is traveling on a road traveling at a low speed. Further, the vehicle display system 1 expands either the left or right right rear video data 120B or the left rear video data 130B corresponding to the road direction when the traveling road is one lane.

  As described above, in the present embodiment, when the vehicle 100 is traveling on a road where the vehicle 100 is traveling at a low speed, the rear side of the vehicle 100 is confirmed on the display surface of the rear view monitor 140 along with the rear side of the vehicle 100. be able to. Further, when the traveling road is one lane on one side, the synthesized rear video data 110C2 in which the right rear video data 120B and the left rear video data 130B corresponding to the roadside direction are enlarged is displayed on the display surface of the rear view monitor 140. For this reason, in the present embodiment, when the traveling road is one lane on one side, an obstacle on the left and right sides of the vehicle 100 can be easily confirmed on the display surface of the rear view monitor 140. This embodiment can reduce the time required for confirmation of the driver's rear and side rear. As described above, the vehicle display system 1 can make it possible to check the vicinity of the appropriate vehicle 100.

[Seventh embodiment]
The vehicle display system 1 according to the present embodiment will be described with reference to FIG. FIG. 29 is a flowchart showing the flow of processing in the control unit of the vehicle display control apparatus of the vehicle display system according to the seventh embodiment. The vehicle display system 1 of the present embodiment is different from the vehicle display system 1 of the first embodiment in the information processing in the control unit 30.

  The traveling state information acquisition unit 60 acquires turning direction (left-right direction) information of the vehicle 100 as information indicating the traveling state of the vehicle 100. The turning direction information is information for estimating the movement of the vehicle 100 in the turning direction. Specifically, the turning direction information includes map information around the vehicle 100, current location information of the vehicle 100, direction indicator operation information of the vehicle 100, gear operation information of the vehicle 100, steering operation information of the vehicle 100, and angular velocity of the vehicle 100. Or at least one piece of information.

  The change in the turning direction of the vehicle 100 is a change in the direction deviating from the direction in which the road on which the vehicle 100 is traveling (hereinafter referred to as “traveling road direction”). The change in the turning direction is a change in the left-right direction toward the front side of the vehicle 100 in the front-rear direction. For example, when turning right or left or changing lanes, the vehicle 100 changes in the turning direction. The change in the turning direction of the vehicle 100 does not include a change in the direction of the vehicle 100 along a curved or curved road.

  When the turning information acquired by the traveling state information acquisition unit 60 indicates a change in the turning direction, the video composition unit 52 is either the right rear video data 120B or the left rear video data corresponding to the changing turning direction. 130B is synthesized. More specifically, the video composition unit 52 synthesizes the left rear video data 130B on the upper left of the rear video data 110B when the turning direction is the left direction. When the turning direction is the right direction, the video synthesis unit 52 synthesizes the right rear video data 120B on the upper right side of the rear video data 110B. For example, the video composition unit 52 may determine that the turning direction has changed when the deviation from the traveling road direction is 15 ° or more. This is because some blurring during driving or play of the steering wheel is not determined as a change in the turning direction of the vehicle 100.

  Information processing in the control unit 30 will be described. The processing in step S73, step S75, and step S76 in the flowchart shown in FIG. 29 is the same as the processing in step S13, step S15, and step S16 in the flowchart shown in FIG.

  The control unit 30 determines whether or not the turning direction has changed (step S71). More specifically, the control unit 30 determines whether or not the traveling state acquired by the traveling state information acquiring unit 60 indicates a change in the turning direction. When it is determined that the turning direction has not changed (No in Step S71), the control unit 30 executes the process of Step S71 again. When it is determined that the turning direction has changed (Yes in Step S71), the control unit 30 proceeds to Step S72.

  The control unit 30 generates the rear video data 110C obtained by combining the right rear video data 120B or the left rear video data 130B corresponding to the turning direction (step S72). More specifically, the control unit 30 causes the video composition unit 52 to generate the rear video data 110C obtained by synthesizing the right rear video data 120B or the left rear video data 130B on the left and right upper sides corresponding to the turning direction of the rear video data 110B. .

  The traveling state information acquisition unit 60 continues to acquire the traveling state even after it is determined in step S71 that the turning direction has changed. More specifically, the control unit 30 continues to acquire the traveling state by the traveling state information acquisition unit 60.

  In step S73, during the period in which the synthesized rear video data 110C is displayed, the control unit 30 determines the end of the change in the turning direction based on the traveling state information acquired by the traveling state information acquiring unit 60 (step S73). S74). When it is determined that the change in the turning direction has not ended (No in Step S74), the control unit 30 continues to display the synthesized rear video data 110C. When it is determined that the change in the turning direction has ended (Yes in Step S74), the control unit 30 generates the rear video data 110B (Step S75) and displays the rear video data 110B (Step S74). S76). That is, in steps S75 and S76, display of the normal rear video data 110B is started and continued as before the determination that the turning direction has changed in step S71.

  In this way, when the turning direction changes, the vehicle display system 1 synthesizes either the right rear video data 120B or the left rear video data 130B corresponding to the turning direction on the left and right upper sides of the rear video data 110B. To do.

  As described above, in the present embodiment, when the turning direction is changing, either the right rear video data 120B or the left rear video data 130B corresponding to the turning direction is synthesized on the left and right upper sides of the rear video data 110B. The rear video data 110 </ b> C is displayed on the display surface of the rear view monitor 140. Accordingly, in the present embodiment, when the turning direction is changed, the rear side of the vehicle 100 can be confirmed on the display surface of the rear view monitor 140 along with the rear of the vehicle 100. For this reason, this embodiment can suppress a driver | operator's eyes | visual_axis movement. This embodiment can reduce the time required for confirmation of the driver's rear and side rear. As described above, the vehicle display system 1 can make it possible to check the vicinity of the appropriate vehicle 100.

  Each component of the illustrated vehicle display system 1 is functionally conceptual, and may not necessarily be physically configured as illustrated. That is, the specific form of each device is not limited to the one shown in the figure, and all or a part of them is functionally or physically distributed or integrated in arbitrary units according to the processing load or usage status of each device. May be.

  The configuration of the vehicle display system 1 is realized by, for example, a program loaded into a memory as software. The above embodiment has been described as a functional block realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

  The components described above include those that can be easily assumed by those skilled in the art and those that are substantially the same. Furthermore, the structures described above can be appropriately combined. In addition, various omissions, substitutions, or changes in the configuration can be made without departing from the scope of the present invention.

  For example, when the determination condition in step S11 of the flowchart illustrated in FIG. 9 is continued for a predetermined time, the control unit 30 may generate the rear video data 110C synthesized in step S12. Thereby, the display system 1 for vehicles can suppress that the image | video displayed on the rear view monitor 140 switches carelessly.

  The control unit 30 may display the range corresponding to the right rear video data 120B and the left rear video data 130B in semi-transparent color with a predetermined transparency in the synthesized rear video data 110C. Thus, the vehicle display system 1 can easily confirm that the display on the rear view monitor 140 includes the right rear video data 120B and the left rear video data 130B.

  In the first embodiment and the third to seventh embodiments, the cutting unit 51 cuts out a part of the first video data 110A from the first video data 110A. However, the present invention is not limited to this. The entire range may be set as the rear video data 110B without cutting out the first video data 110A.

  The cutting unit 51 cuts out the right rear video data 120B and the left rear video data 130B to be displayed on the right side view monitor 150 and the left side view monitor 160 from the second video data, but is not limited thereto. The entire range may be the right rear video data 120B and the left rear video data 130B without cutting out the second video data.

  Although the right side view monitor 150 and the left side view monitor 160 are provided, a conventional optical right side mirror and left side mirror may be provided.

  In the third embodiment, the detection unit 80 performs pattern matching using the recognition dictionary stored in the recognition dictionary storage unit 300 on the rear video data 110B to detect the presence of an obstacle. The obstacle detection method is not limited to this. The detection unit 80 may recognize the road surface behind the vehicle 100 in the road surface recognition process with respect to the rear video data 110B, and may recognize an object positioned above the detected road surface as an obstacle.

  In the fifth embodiment and the sixth embodiment, it is determined whether or not a single-lane road is indicated based on the road information acquired by the traveling state information acquisition unit 60. However, the present invention is not limited to this. The video composition unit 52 may perform lane recognition processing on the first video data 110 </ b> A to determine whether or not the traveling road is one lane on one side.

  The right rear video data 120B and the left rear video data 130B synthesized on the left and right upper sides of the rear video data 110B are the right rear video data and the left rear video data (hereinafter referred to as “the right side view monitor 150 and the left side view monitor 160”). It may be a cut-out range different from “side-view monitor video”. For example, the right rear video data 120B and the left rear video data 130B may cut out the same range as the side view monitor video. Alternatively, for example, the right rear video data 120B and the left rear video data 130B may be cut out from a wider range than the side view monitor video. Alternatively, for example, the right rear video data 120B and the left rear video data 130B may be cut out of a narrower range than the side view monitor video. In this case, the right rear video data 120B and the left rear video data 130B synthesized on the upper left and right sides of the rear video data 110B may be displayed with a narrower range than the side view monitor video. Further, the right rear video data 120B and the left rear video data 130B synthesized at the upper left and right of the rear video data 110B may have the same size as the rear video data 110B.

  For example, the size of the clipping range by the clipping unit 51 and the size of the right rear video data 120B or the left rear video data 130B on the display surface of the rear view monitor 140 can be adjusted while the driver is stopped. Good. At that time, for example, the cutting range and size may be set to a desired size by an operation of reducing or widening the interval between two fingers on the display surface of the rear view monitor 140. Further, for example, each time the display surface of the rear view monitor 140 is touched, the cutout range and size may be changed stepwise.

  In the second embodiment, when the cutout range is shifted downward and the rear video data 110B2 is cut out, the cutout range is shifted downward and the right rear video data 120B and the left rear video data 130B are cut out. May be. Alternatively, when the rear image data 110B2 is extracted by shifting the cutout range downward, the cutout range is set for either the right rear video data 120B or the left rear video data 130B corresponding to the turning direction of the vehicle 100. You may shift downward.

DESCRIPTION OF SYMBOLS 1 Display system for vehicles 10 Display control apparatus for vehicles 30 Control part 40 Image | video data acquisition part 41 Side rear image | video data acquisition part 42 Back image | video data acquisition part 50 Image | video processing part 51 Cutout part 52 Image | video synthetic | combination part 60 Running condition information acquisition part 70 Display Control Unit 100 Vehicle 110 Rear Camera 120 Right Rear Camera (Side Rear Camera)
130 Left rear camera (side rear camera)
140 Rear view monitor (display device)
150 Right side view monitor (side rear confirmation device)
160 Left side view monitor (side rear confirmation device)

Claims (14)

A rear video data acquisition unit that is arranged to face the rear of the vehicle and acquires rear video data from a rear camera that captures the rear of the vehicle;
A side rear video data acquisition unit arranged to face the rear of the vehicle on the left and right sides of the vehicle, and for acquiring side rear video data from a side rear camera that captures the left and right sides of the vehicle;
A travel status information acquisition unit for acquiring information indicating the travel status of the vehicle;
In accordance with the driving situation acquired by the driving situation information acquisition unit, a video composition unit that synthesizes the side rear video data on the left and right upper sides of the rear video data;
A display control unit that displays the rear video data synthesized by the video synthesis unit on a display device that displays the rear video of the vehicle;
A vehicle display control device comprising: The video synthesizing unit synthesizes the side rear video data on the upper left and right sides of the rear video data so that the side rear video data is about an upper half of the vertical size of the display surface of the display device. ,
The vehicle display control apparatus according to claim 1. The video synthesizing unit synthesizes the side rear video data on the left and right upper sides of the rear video data so that the side rear video data is about one third of the left and right in the horizontal size of the display surface of the display device. To
The vehicle display control device according to claim 1. The traveling state information acquisition unit acquires information indicating that the vehicle moves backward,
The video composition unit synthesizes the side rear video data on the left and right upper sides of the rear video data when the traveling state information acquisition unit acquires information indicating that the vehicle moves backward.
The vehicle display control device according to any one of claims 1 to 3. A cutting section that cuts out a display range to be displayed on the display device from the rear video data,
The cut-out unit cuts out the lower side than when the vehicle display control device displays the synthesized rear video data on the display device, when displaying the rear video data not synthesized,
The vehicle display control apparatus according to any one of claims 1 to 4. The travel status information acquisition unit acquires information on the travel speed of the vehicle as information indicating the travel status of the vehicle,
The video composition unit, when the traveling situation information acquisition unit obtains information indicating that the vehicle is in a low-speed traveling situation, synthesizes the side rear video data on the left and right upper side of the rear video data,
The vehicle display control device according to any one of claims 1 to 3. The travel status information acquisition unit acquires information on the travel path of the vehicle as information indicating the travel status of the vehicle,
When the information about the travel road acquired by the travel condition information acquisition unit indicates a one-lane road, the video composition unit is located on either the left or right side of the rear video data, corresponding to the roadside direction. Combining the side rear video data;
The vehicle display control device according to any one of claims 1 to 3. The travel status information acquisition unit acquires information on the travel path of the vehicle as information indicating the travel status of the vehicle,
The video composition unit synthesizes the side rear video data on the left and right upper sides of the rear video data when the information on the travel route acquired by the travel condition information acquisition unit indicates a road that runs at a low speed. To
The vehicle display control device according to any one of claims 1 to 3. When the information about the travel road acquired by the travel condition information acquisition unit indicates a one-lane road, the video composition unit is located on either the left or right side of the rear video data, corresponding to the roadside direction. Enlarging and compositing the side rear video data,
The vehicle display control apparatus according to claim 8. The travel status information acquisition unit acquires the turning direction information of the vehicle as information indicating the travel status of the vehicle,
When the turning direction information acquired by the traveling state information acquisition unit indicates a change in the turning direction, the video composition unit is located on either the left or right side corresponding to the turning direction at the upper left or right of the rear video data. Synthesize video data,
The vehicle display control device according to any one of claims 1 to 3. A detection unit for detecting obstacles on the left and right sides of the rear video data,
When the detection unit detects an obstacle on the left and right sides of the rear video data, the video synthesis unit has at least one of right and left corresponding to the direction in which the obstacle is detected. Enlarge and synthesize the side rear video data of
The vehicle display control device according to claim 4, 7 or 10. The vehicle display control device according to any one of claims 1 to 11,
A vehicle display system comprising at least one of the display device, the rear camera, and the side rear camera. A rear video data acquisition step that is arranged to face the rear of the vehicle and acquires rear video data from a rear camera that captures the rear of the vehicle;
A side rear image data acquisition step for acquiring side rear image data from a side rear camera that is disposed on the left and right sides of the vehicle so as to face the rear of the vehicle, and captures the left and right sides of the vehicle,
A driving condition information acquisition step of acquiring information indicating the driving condition of the vehicle;
In accordance with the driving situation acquired by the driving situation information acquisition step, a video synthesis step of synthesizing the side rear video data on the left and right upper sides of the rear video data;
A display control step for displaying the rear video data synthesized by the video synthesis step on a display device for displaying the rear video of the vehicle;
A vehicle display control method including: A rear video data acquisition step that is arranged to face the rear of the vehicle and acquires rear video data from a rear camera that captures the rear of the vehicle;
A side rear image data acquisition step for acquiring side rear image data from a side rear camera that is disposed on the left and right sides of the vehicle so as to face the rear of the vehicle, and captures the left and right sides of the vehicle,
A driving condition information acquisition step of acquiring information indicating the driving condition of the vehicle;
In accordance with the driving situation acquired by the driving situation information acquisition step, a video synthesis step of synthesizing the side rear video data on the left and right upper sides of the rear video data
A display control step for displaying the rear video data synthesized by the video synthesis step on a display device for displaying the rear video of the vehicle;
For causing a computer that operates as a display control device for a vehicle to execute.

Images