JP6910457B2 - Display control device and display control method - Google Patents

Description

The present invention relates to a display control device and a display control method for controlling a display device.

In recent years, instead of door mirrors, electronic mirrors have been proposed that present the driver with the situation on the left, right, rear, and side of the vehicle. In the electronic mirror, the left and right rear sides of the vehicle are photographed by the camera, and the image obtained by the photographing is inverted left and right and displayed on the display device. For example, Patent Document 1 proposes an electronic mirror that displays a situation behind a vehicle traveling lane and an adjacent lane.

JP-A-2015-144407

Apart from the above, a naked-eye stereoscopic display that displays images with a sense of depth, that is, a sense of perspective, is proposed by displaying images for the left eye and the right eye that cause parallax in the left and right eyes of the user. Has been done. By applying this autostereoscopic display to an electronic mirror, the user can visually recognize an electronic mirror similar to the stereoscopic surface of an existing door mirror.

However, in such a configuration, the images for the right eye and the left eye for performing the autostereoscopic display of the left electronic mirror, and the images for the right eye and the right eye for performing the autostereoscopic display of the right electronic mirror. A total of four images, an image for the left eye, are required. For this reason, in the configuration using four cameras for capturing each of the four images, there is a problem that the hardware cost is relatively high and the power consumption is relatively high when the four cameras are activated.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a technique capable of reducing the number of cameras for performing autostereoscopic display.

The display control device according to the present invention is a display control device that controls a display device provided in a vehicle, and the display device can perform stereoscopic display with the naked eye by displaying images for the left eye and the right eye. An acquisition unit that acquires one photographed image around the vehicle and display surface generation information for generating an autostereoscopic display surface that is a surface on the autostereoscopic display surface, and a photographing unit acquired by the acquisition unit. It is provided with a control unit that controls the display of the captured image on the stereoscopic display surface with naked eyes based on the image and the display surface generation information. The display surface generation information includes a shooting direction which is a direction related to the captured image, and the control unit rotates the stereoscopic display surface with the naked eye by associating the shooting direction with the normal direction of the stereoscopic display surface with the naked eye based on the shooting direction. Control the movement.

According to the present invention, control is performed to display a captured image on a stereoscopic display surface with naked eyes based on one captured image and display surface generation information. With such a configuration, the number of cameras for performing autostereoscopic display can be reduced.

The objects, features, embodiments and advantages of the present invention will be made clearer by the following detailed description and accompanying drawings.

It is a block diagram which shows the structure of the display control device which concerns on Embodiment 1. FIG. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 2. FIG. It is a figure for demonstrating the camera direction which concerns on Embodiment 2. FIG. It is a figure for demonstrating the adjustment example of a mirror. It is a figure for demonstrating the adjustment example of a mirror. It is a perspective view which shows typically the autostereoscopic display surface which concerns on Embodiment 2. FIG. It is a perspective view which shows typically the autostereoscopic display surface which concerns on Embodiment 2. FIG. It is a figure which shows the display example of the naked eye stereoscopic display surface which concerns on Embodiment 2. FIG. It is a perspective view which shows typically the autostereoscopic display surface which concerns on Embodiment 2. FIG. It is a figure which shows the display example of the naked eye stereoscopic display surface which concerns on Embodiment 2. FIG. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 2. FIG. It is a figure which shows the relationship between the rotation angle of the autostereoscopic display surface, and the camera direction. It is a figure which shows the relationship between the rotation angle of the autostereoscopic display surface, and the camera direction. It is a figure which shows the relationship between the rotation angle of the autostereoscopic display surface, and the camera direction. It is a figure which shows the relationship between the rotation angle of the autostereoscopic display surface, and the camera direction. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 2 of Embodiment 2. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 2 of Embodiment 2. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 3 of Embodiment 2. It is a figure for demonstrating the camera direction which concerns on the modification 4 of Embodiment 2. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 4 of Embodiment 2. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 3. FIG. It is a figure which shows the photographing area of a standard camera and a wide-angle camera. It is a figure which shows an example of the image taken by a wide-angle camera. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 4. FIG. It is a perspective view which shows typically the autostereoscopic display surface which concerns on Embodiment 5. It is a perspective view which shows typically the autostereoscopic display surface which concerns on Embodiment 5. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 6. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 6. It is a perspective view which shows typically the autostereoscopic display surface which concerns on Embodiment 7. It is a figure which shows the display example of the naked eye stereoscopic display surface which concerns on Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 1 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 1 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 2 of Embodiment 7. It is a figure which shows the display example of the naked eye stereoscopic display surface which concerns on the modification 2 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 3 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 3 of Embodiment 7. It is a figure which shows the display example of the naked eye stereoscopic display surface which concerns on the modification 3 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 4 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 5 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 5 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 6 of Embodiment 7. It is a figure which shows the display example of the naked eye stereoscopic display surface which concerns on the modification 6 of Embodiment 7. It is a perspective view which shows typically the autostereoscopic display surface which concerns on the modification 7 of Embodiment 7. It is a top view which shows typically the autostereoscopic display surface which concerns on the modification 7 of Embodiment 7. It is a front view which shows typically the autostereoscopic display surface which concerns on the modification 7 of Embodiment 7. It is a block diagram which shows the hardware composition of the display control device which concerns on other modification. It is a block diagram which shows the hardware composition of the display control device which concerns on other modification. It is a block diagram which shows the structure of the server which concerns on other modification. It is a block diagram which shows the structure of the communication terminal which concerns on other modification.

<Embodiment 1>
Hereinafter, a vehicle on which the display control device according to the first embodiment of the present invention is mounted and which is the subject of attention will be described as “own vehicle”.

FIG. 1 is a block diagram showing a configuration of a display control device 1 according to the first embodiment. The display control device 1 of FIG. 1 includes an acquisition unit 11 and a control unit 12, and can control the display device 21.

The display device 21 is arranged on, for example, an instrument panel of the own vehicle, a dashboard, or the like. The display device 21 enables autostereoscopic display by displaying images for the left eye and the right eye. The image for the left eye is an image that is not visible to the user's right eye but is visible to the left eye, and the image for the right eye is not visible to the user's left eye but is visible to the right eye. It is an image. For displaying such images for the left eye and the right eye, for example, a polarizing filter method and a liquid crystal shutter method are used.

The image for the left eye and the image for the right eye are partially different from each other to the extent that they cause parallax in the user's left eye and right eye, and this parallax allows the user to visually recognize a three-dimensional image. It is possible.

The acquisition unit 11 acquires one captured image and display surface generation information. One captured image is an image used for displaying the display device 21, for example, one image behind the own vehicle, one image on the side of the own vehicle, or one image in front of the own vehicle. It is one image of the surroundings. The captured image when the door mirror is displayed is an image for mirror display in which the image behind the own vehicle is flipped horizontally. The captured image may be the entire image captured by a camera or the like, or may be a part of the image. The display surface generation information is information for generating the autostereoscopic display surface, which is a surface on the autostereoscopic display. Specific examples of this display surface generation information will be described in the second and subsequent embodiments. The acquisition unit 11 may be a camera or various interfaces.

The control unit 12 controls to display the captured image on the autostereoscopic display surface based on one captured image acquired by the acquisition unit 11 and the display surface generation information acquired by the acquisition unit 11.

For example, the control unit 12 generates an image for the left eye in which the portion corresponding to the naked-eye stereoscopic display surface in one captured image is shifted in one of the left and right directions, and the naked-eye stereoscopic image in one captured image is generated. An image in which the portion corresponding to the visual display surface is shifted in the direction opposite to the above one direction is generated as an image for the right eye. As a result, the degree of parallax of the user with respect to the portion of one captured image corresponding to the stereoscopic display surface of the naked eye is different from the degree of parallax of the user with respect to the other images. As a result, to the user, the position of the portion corresponding to the autostereoscopic display surface and the position of the other images appear to be different in the depth direction, and the autostereoscopic display surface can be seen stereoscopically. ..

For example, the control unit 12 determines whether or not to generate an inclined autostereoscopic display surface from the display screen of the display device 21 based on the display surface generation information. Then, when the control unit 12 determines that an inclined autostereoscopic display surface is generated, the control unit 12 changes the magnitude of the shift based on the inclination of the autostereoscopic display surface. The control unit 12 controls the display device 21 to display the images for the left eye and the right eye obtained by the above processing.

<Summary of Embodiment 1>
The display control device 1 according to the first embodiment as described above controls to display the one captured image on the autostereoscopic display surface based on the one captured image and the display surface generation information. .. According to such a configuration, one electronic mirror or the like can be stereoscopically displayed with the naked eye from one captured image. Therefore, if two cameras that acquire a photographed image on the left rear side and a photographed image on the right rear side of the own vehicle are used, the left and right electronic mirrors can be stereoscopically displayed with the naked eye. As a result, the number of cameras for displaying the left and right electronic mirrors in a stereoscopic manner with the naked eye can be reduced, so that the hardware cost and power consumption can be reduced.

Further, when four cameras are used, all parts of the image taken by the cameras are displayed stereoscopically with the naked eye, so that the burden on the user's eyes is relatively large. On the other hand, in the first embodiment, since the autostereoscopic display surface, that is, a part of the image taken by the camera is stereoscopically displayed with the naked eye, the effect of reducing the burden on the user's eyes can be expected. ..

<Embodiment 2>
FIG. 2 is a block diagram showing a configuration of a display control device 1 according to a second embodiment of the present invention. Hereinafter, among the components according to the second embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

The display control device 1 of FIG. 2 is connected to the left autostereoscopic display device 21a, the right autostereoscopic display device 21b, and the camera control device 26d.

Each of the left naked-eye stereoscopic display device 21a and the right naked-eye stereoscopic display device 21b corresponds to the display device 21 of FIG. The left naked-eye stereoscopic display device 21a displays images for the left eye and the right eye for displaying the left electronic mirror in the naked-eye stereoscopic view, and the right naked-eye stereoscopic display device 21b displays the right electronic mirror in the naked-eye stereoscopic view. Display images for the left eye and for the right eye. One naked-eye stereoscopic display device may be used instead of the left naked-eye stereoscopic display device 21a and the right naked-eye stereoscopic display device 21b. Hereinafter, when the left naked-eye stereoscopic display device 21a and the right naked-eye stereoscopic display device 21b are not distinguished, they may be described as “display device 21”.

The camera control device 26d is connected to the left rear side camera 26a, the right rear side camera 26b, and the operation device 26c.

The left rear side camera 26a is a camera that photographs the left rear side of the own vehicle, and is provided in the own vehicle instead of the left door mirror. The right rear side camera 26b is a camera that photographs the right rear side of the own vehicle, and is provided in the own vehicle instead of the right door mirror. In the second embodiment, each of the left rear side camera 26a and the right rear side camera 26b is neither a panoramic camera nor a wide-angle camera, but is a standard camera that captures an image having an angle of view of about 10 degrees. It is explained as.

In the following description, the image for mirror display based on the image taken by the left rear side camera 26a may be referred to as "left camera image", and is based on the image taken by the right rear side camera 26b. The image for mirror display may be referred to as a "right camera image", and when the left camera image and the right camera image are not distinguished, these may be referred to as a "camera image".

Further, in the following description, the direction taken by the left rear side camera 26a may be referred to as "left camera direction", and the direction taken by the right rear side camera 26b may be referred to as "right camera direction". , When the left camera direction and the right camera direction are not distinguished, these may be referred to as "camera direction".

FIG. 3 is a diagram showing an example of the left camera direction and the right camera direction in the own vehicle 3. In the second embodiment, the reference direction in the left camera direction is the rearward direction D1 of the own vehicle 3, and the left camera direction is the direction forming an angle θl1 with the rearward direction D1. Further, in the second embodiment, the reference direction in the right camera direction is the rearward direction D1 of the own vehicle 3, and the right camera direction is the direction forming an angle θr1 with the rearward direction D1. However, the reference direction of the camera direction may be, for example, a standard adjusted direction described later with reference to FIGS. 4 and 5, or is preset and stored in the display control device 1 by the user. It may be in the same direction.

Since the left camera direction and the angle θl1 have a one-to-one relationship, in the following description, the left camera direction and the angle θl1 are treated the same and may be referred to as the left camera direction θl1. Similarly, since the right camera direction and the angle θr1 have a one-to-one relationship, in the following description, the right camera direction and the angle θr1 are treated the same and may be referred to as the right camera direction θr1.

The operation device 26c of FIG. 2 is, for example, an operation switch, and is an operation for individually changing the left camera direction and the right camera direction, and the angles of view of the left rear side camera 26a and the right rear side camera 26b are individually changed. Accepts operations to change.

The camera control device 26d appropriately controls the left rear side camera 26a and the right rear side camera 26b to change the camera direction, the angle of view, and the focus based on the operation received by the operation device 26c. According to such a configuration, the range captured by the left rear side camera 26a and the right rear side camera 26b can be appropriately adjusted by appropriately performing the operation in the operation device 26c.

4 and 5 are views showing an example of adjusting a mirror image of a standard door mirror. Although a general example of adjusting the door mirror will be described here, the adjustment of the range captured by the left rear side camera 26a and the right rear side camera 26b is also performed in the same manner as the adjustment of the door mirror.

As shown in FIG. 4, the door mirrors are adjusted so that the vehicle is located 30 m behind the rear of the own vehicle 3 and the width range of 5 m from the side of the own vehicle to the side is visible to the driver. As shown in FIG. 5, the body of the own vehicle 3 is visually recognized by the driver within a range of about 1/4 of the lateral length of the mirror surface 4a from the left end of the mirror surface 4a of the right door mirror 4, and the mirror surface is visible from the lower end of the mirror surface 4a. The right door mirror 4 is adjusted so that the road 5 can be visually recognized by the driver within a range of about 1/3 of the vertical length of 4a. The left door mirror is adjusted by reversing the left and right in the adjustment of the right door mirror. The recommended adjustments for the left and right door mirrors vary depending on the left and right door mirrors, the recommended values for each country, and the size and type of the left and right door mirrors.

Returning to FIG. 2, the camera control device 26d not only controls the left rear side camera 26a and the right rear side camera 26b as described above, but also controls the left rear side camera 26a and the right rear side camera 26b. The captured left camera image and right camera image, and the left camera direction and the right camera direction of the left rear side camera 26a and the right rear side camera 26b are output to the display control device 1.

Next, the internal configuration of the display control device 1 of FIG. 2 will be described. The display control device 1 includes an image acquisition unit 11a, a display surface generation information acquisition unit 11b, a video processing unit 12a, and an image output unit 12b. The concept of the image acquisition unit 11a and the display surface generation information acquisition unit 11b is a concept included in the acquisition unit 11 of FIG. 1, and the concept of the video processing unit 12a and the image output unit 12b is the control unit 12 of FIG. It is a concept included in.

The image acquisition unit 11a acquires a camera image from the camera control device 26d as a captured image.

The display surface generation information acquisition unit 11b acquires the camera direction from the camera control device 26d as the shooting direction which is the direction related to the shot image.

The image processing unit 12a displays the autostereoscopic display surface with the naked eye based on the camera image which is the captured image acquired by the image acquisition unit 11a and the camera direction which is the photographing direction acquired by the display surface generation information acquisition unit 11b. Generate. That is, in the second embodiment, the image processing unit 12a uses the camera direction as the display surface generation information described in the first embodiment.

FIG. 6 is a diagram showing an autostereoscopic display surface generated by the image processing unit 12a according to the second embodiment. In the following description, the autostereoscopic display surface corresponding to the left camera image may be referred to as the "left autostereoscopic display surface", and the autostereoscopic display surface corresponding to the right camera image may be referred to as the "right autostereoscopic display surface". It may be written as.

As shown in FIG. 6, both the left autostereoscopic display surface SL and the right autostereoscopic display surface SR are flat surfaces. For the left autostereoscopic display surface SL, the xyz axis is defined for the upward, left, and depth directions of the display screen of the display device 21, and for the right autostereoscopic display surface SR, the display screen of the display device 21. The xyz axis is defined for the upward direction, the right direction, and the depth direction.

The image processing unit 12a according to the second embodiment controls the rotation of the left autostereoscopic display surface SL with respect to a predetermined axis based on the left camera direction θl1. Specifically, the image processing unit 12a uses the right side of the left autostereoscopic display surface SL as a predetermined axis, and is left in the depth direction from the display screen DS of the display device 21 with reference to the axis. The left autostereoscopic display surface SL is rotated by the same angle θl2 as the camera direction θl1. In the following description, the angle θl2 that defines the rotation of the left autostereoscopic display surface SL may be referred to as “left rotation angle θl2”.

Similarly, the image processing unit 12a according to the second embodiment controls the rotation of the right autostereoscopic display surface SR with respect to a predetermined axis based on the right camera direction θr1. Specifically, the image processing unit 12a uses the left side of the right autostereoscopic display surface SR as a predetermined axis, and is right in the depth direction from the display screen DS of the display device 21 with reference to the axis. The right autostereoscopic display surface SR is rotated by the same angle θr2 as the camera direction θr1. In the following description, the angle θr2 that defines the rotation of the right autostereoscopic display surface SR may be referred to as “right rotation angle θr2”, and the left rotation angle θl2 and the right rotation angle θr2 are referred to as “right rotation angle θr2”. When no distinction is made, these may be referred to as "rotation angles".

FIG. 7 shows the left naked-eye stereoscopic display according to the second embodiment when the left camera direction θl1 = left rotation angle θl2 = 0 degrees and the right camera direction θr1 = right rotation angle θr2 = 0 degrees. It is a figure which shows typically the surface SL and the right naked-eye stereoscopic display surface SR. In this case, the normal directions of the left autostereoscopic display surface SL and the right autostereoscopic display surface SR are the same as the vertical direction of the display screen DS of the display device 21.

FIG. 8 is a diagram showing a specific display example of the display of FIG. 7. In the example of FIG. 8, the left autostereoscopic display device 21a and the right autostereoscopic display device 21b are provided with the meter area 7 provided with the meter sandwiched between them, and the left autostereoscopic display surface SL and the right autostereoscopic display device 21b are provided. The visual display surface SR is displayed as a left electronic mirror and a right electronic mirror, respectively. The body of the own vehicle 3, the road 5, and the other vehicle 6 are displayed on the left naked-eye stereoscopic display surface SL, and the body of the own vehicle 3 and the road 5 are displayed on the right naked-eye stereoscopic display surface SR. It is displayed.

FIG. 9 shows the left naked-eye stereoscopic display according to the second embodiment when the left camera direction θl1 = left rotation angle θl2 ≠ 0 degrees and the right camera direction θr1 = right rotation angle θr2 ≠ 0 degrees. It is a figure which shows typically the surface SL and the right naked-eye stereoscopic display surface SR. In this case, the normal directions of the left autostereoscopic display surface SL and the right autostereoscopic display surface SR are only the left rotation angle θl2 and the right rotation angle θr2 with respect to the vertical direction of the display screen DS of the display device 21, respectively. The angle is outward.

FIG. 10 is a diagram showing a specific display example of the display of FIG. In the example of FIG. 10, the state of FIG. 8 is changed to the state of left camera direction θl1 = left rotation angle θl2> 0 degrees and right camera direction θr1 = right rotation angle θr2> 0 degrees. Further, since the left camera direction θl1 is sufficiently larger than 0 degrees, the body of the own vehicle 3 is not displayed on the left autostereoscopic display device 21a, and the right camera direction θr1 is sufficiently larger than 0 degrees. , The body of the own vehicle 3 is not displayed on the right autostereoscopic display device 21b.

The image on the left side, which is the outside of the left electronic mirror, is located on the back side of the image on the right side, which is the inside of the left electronic mirror. In consideration of this, as shown in FIG. 10, the right side, which is the outer side of the left electronic mirror, may be displayed shorter than the left side, which is the inner side of the left electronic mirror. Similarly, as shown in FIG. 10, the left side, which is the outer side of the right electronic mirror, may be displayed shorter than the right side, which is the inner side of the right electronic mirror. This will be described in detail with reference to the fifth modification of the seventh embodiment. Since the display control device 1 according to the second embodiment can perform the display as shown in FIGS. 7 to 10 as described above, it is possible to display an electronic mirror similar to an actual door mirror.

The image output unit 12b of FIG. 2 transmits the image signals of the left-eye and right-eye images for displaying the left-eye stereoscopic display surface SL generated by the image processing unit 12a to the left-eye stereoscopic display device 21a. Output. Further, the image output unit 12b transmits the image signals of the left-eye and right-eye images for displaying the right-eye stereoscopic display surface SR generated by the image processing unit 12a to the right-eye stereoscopic display device 21b. Output.

<Operation>
FIG. 11 is a flowchart showing the operation of the display control device 1 according to the second embodiment. This operation is started, for example, when the accessory power of the own vehicle is turned on, or when the drive source of the own vehicle is turned on.

First, in step S1, the display surface generation information acquisition unit 11b acquires the left camera direction θl1 and the right camera direction θr1.

In step S2, the image processing unit 12a determines the left rotation angle θl2 of the left autostereoscopic display surface SL based on the left camera direction θl1. Similarly, the image processing unit 12a determines the right rotation angle θr2 of the right autostereoscopic display surface SR based on the right camera direction θr1.

In step S3, the image acquisition unit 11a acquires the left camera image and the right camera image.

In step S4, the image processing unit 12a performs image processing on the left camera image based on the left rotation angle θl2, so that the left eye stereoscopic display surface SL can be displayed for the left eye and the right eye. Generate an image. Similarly, the image processing unit 12a performs image processing on the right camera image based on the right rotation angle θr2 to display images for the left eye and the right eye for displaying the right autostereoscopic display surface SR. Generate.

In step S5, the image output unit 12b outputs the image signals of the left-eye and right-eye images for displaying the left-eye stereoscopic display surface SL to the left-eye stereoscopic display device 21a, and outputs the right-eye stereoscopic display device 21a. The image signals of the left-eye and right-eye images for displaying the visual display surface SR are output to the right-eye stereoscopic display device 21b. After that, the process returns to step S1.

<Summary of Embodiment 2>
The display control device 1 according to the second embodiment as described above controls the rotation of the autostereoscopic display surface with respect to a predetermined axis based on the camera direction (shooting direction). With such a configuration, it is possible to display an electronic mirror similar to a real door mirror.

Further, in the second embodiment, the camera direction (shooting direction) is changed based on the operation from the outside of the display control device 1. According to such a configuration, the user can perform an operation for the rotation of the electronic mirror in the same manner as the operation for the rotation of the actual door mirror.

<Modification 1 of Embodiment 2>
In the second embodiment, as shown in FIG. 12, the rotation angles θl2 and θr2 of the autostereoscopic display surface are the same as those in the camera directions θl1 and θr1, respectively. That is, the amount of rotation of the autostereoscopic display surface was the same as the amount of change in the angle in the camera direction. However, the amount of rotation of the autostereoscopic display surface may be different from the amount of change in the angle in the camera direction.

For example, the rotation angles θl2 and θr2 of the autostereoscopic display surface may be the values of the functions fl (θl1) and fr (θr1) of the camera directions θl1 and θr1.

As shown in FIG. 13 as a first example, the functions fr (θl1) and fr (θr1) are fl (θl1) = k × θl1 and fr (θr1) = k × using k satisfying 0 <k <1. It may be expressed as θr1. In this case, the amount of rotation of the autostereoscopic display surface is less than or equal to the amount of change in the angle in the camera direction.

As shown in FIG. 14 as a second example, the difference between the camera directions θl1 and θr1 and the reference direction of the camera directions θl1 and θr1 (here, the direction corresponding to the camera direction = 0 degrees) is a predetermined threshold value Tθ. If it is smaller, the functions fr (θl1) and fr (θr1) may be 0. Then, when the difference between the camera directions θl1, θr1 and the reference direction of the camera directions θl1, θr1 (here, the direction corresponding to the camera direction = 0 degrees) is equal to or greater than a predetermined threshold value Tθ, the function fr ( θl1) and fr (θr1) may be increasing functions of the camera directions θl1 and θr1. According to such a configuration, the image processing unit 12a displays the autostereoscopic display with the naked eye when the difference between the camera directions θl1 and θr1 and the reference direction of the camera directions θl1 and θr1 is equal to or greater than a predetermined threshold value Tθ. The surface will be rotated.

As shown in FIG. 15 as a third example, the functions fr (θl1) and fr (θr1) are increasing functions of the camera directions θl1 and θr1, and the degree of increase in the values gradually decreases. May be good. Further, the values of the functions fr (θl1) and fr (θr1) may be provided with an upper limit value such as 45 degrees in FIGS. 13 to 15.

The functions fr (θl1) and fr (θr1) are not limited to the above, and any other equation can be used. Further, the function fr (θl1) and the function fr (θr1) may be the same or different. For example, even if the amount of change in the left camera direction θl1 and the amount of change in the right camera direction θr1 are the same, one of the left naked-eye stereoscopic display surface SL and the right naked-eye stereoscopic display surface SR, which is closer to the driver's seat, is displayed. Functions fl (θl1) and fr (θr1) may be used so that the amount of rotation of the surface is smaller than the amount of rotation of the other display surface. According to such a configuration, the rotation of the autostereoscopic display surface can be controlled in consideration of the distance between the driver and the mirror.

<Modification 2 of Embodiment 2>
In the second embodiment, the axis (hereinafter referred to as "left rotation axis") that serves as a reference for the rotation of the left autostereoscopic display surface SL is the right side of the left autostereoscopic display surface SL (FIG. 6). The axis that serves as a reference for the rotation of the right autostereoscopic display surface SR (hereinafter referred to as “right rotation axis”) was the left side of the right autostereoscopic display surface SR (FIG. 6).

However, for example, as shown in FIG. 16, the position of the left rotation axis may be the position of the central portion in the left-right direction of the left autostereoscopic display surface SL, and the position of the right rotation axis may be the position of the right naked eye. It may be the position of the central portion in the left-right direction of the stereoscopic display surface SR. Further, for example, as shown in FIG. 17, the position of the left rotation axis may be the position of the left side of the left naked eye stereoscopic display surface SL, and the position of the right rotation axis may be the position of the right naked eye stereoscopic display surface SR. It may be the position on the right side of.

The positions of the left rotation shaft and the right rotation shaft may be preset and stored in the display control device 1 by the user. Further, the image processing unit 12a may move the left rotation axis and the right rotation axis based on the rotation angles θl2 and θr2 of the autostereoscopic display surface. For example, the image processing unit 12a may bring the left rotation axis closer to the left side of the left autostereoscopic display surface SL as the left rotation angle θl2 increases, and may move the right rotation axis as the right rotation angle θr2 increases. It may be brought closer to the right side of the right autostereoscopic display surface SR.

<Modification 3 of Embodiment 2>
In the second embodiment, both the left autostereoscopic display surface SL and the right autostereoscopic display surface SR are flat surfaces. However, the left naked-eye stereoscopic display surface SL and the right naked-eye stereoscopic display surface SR may be curved surfaces as shown in FIG.

Then, the image processing unit 12a controls the angle θl3 between the curved left autostereoscopic display surface SL and the reference direction of the left autostereoscopic display surface SL based on the left camera direction θl1. , The rotation of the left autostereoscopic display surface SL may be controlled. In FIG. 18, the angle θl3 is an angle between the line connecting the right side of the curved surface and the left side of the curved surface and the x-axis direction which is the reference direction. However, the angle θl3 is not limited to this, and may be an angle between the tangent line of the curved surface on the right side of the curved surface and the x-axis direction which is the reference direction.

Similarly, the image processing unit 12a controls the angle θr3 between the curved right autostereoscopic display surface SR and the reference direction of the right autostereoscopic display surface SR based on the right camera direction θr1. The rotation of the right autostereoscopic display surface SR may be controlled accordingly. In FIG. 18, the angle θr3 is an angle between the line connecting the left side of the curved surface and the right side of the curved surface and the x-axis direction which is the reference direction. However, the angle θr3 is not limited to this, and may be an angle between the tangent line of the curved surface on the left side of the curved surface and the x-axis direction which is the reference direction.

Further, the curved surface may be convex toward the back side of the display screen DS of the display device 21 as shown in FIG. 18, or may be convex toward the back side of the display screen DS (not shown).

<Modification 4 of Embodiment 2>
In the second embodiment, the camera direction and the rotation angle of the autostereoscopic display surface with the naked eye are the directions and angles corresponding to the horizontal angles. However, the camera direction and the rotation angle of the autostereoscopic display surface may be the direction and angle corresponding to the elevation / depression angle, for example, as shown in FIGS. 19 and 20.

Specifically, as shown in FIG. 19, the left camera direction αl1 of the left rear side camera 26a may be a row / depression angle with respect to the horizontal direction D2. In this case, the image processing unit 12a refers to the lower side of the left autostereoscopic display surface SL as a reference, and from the display screen DS of the display device 21 in the depth direction, the left autostereoscopic image processing unit 12a has the left autostereoscopic angle αl2 corresponding to the left camera direction αl1. The visual display surface SL may be rotated.

Although not shown, the right camera direction of the right rear side camera 26b may also be a row / depression angle based on the horizontal direction. In this case, the image processing unit 12a displays the right autostereoscopic display by the angle corresponding to the right camera direction from the display screen DS of the display device 21 with reference to the lower side of the right autostereoscopic display surface SR. The surface SR may be rotated.

In actual operation, the camera direction may be directed upward as shown in FIG. 19 so that the display device 21 displays as shown in FIG. 5, that is, the road 5 in a certain range is displayed. It is thought that it is often directed downwards.

<Modification 5 of Embodiment 2>
Combining the modified example 4 of the second embodiment and the second embodiment, the rotation angle of the camera direction and the stereoscopic display surface with the naked eye may be a direction and an angle corresponding to both the horizontal angle and the elevation / depression angle. .. That is, the image processing unit 12a may control the left naked-eye stereoscopic display surface SL and the right naked-eye stereoscopic display surface SR to rotate with reference to two axes, the vertical axis and the horizontal axis.

Further, the rotation of the autostereoscopic display surface does not necessarily have to be linked to the change in the camera direction. For example, the operation device 26c may be configured to accept a dedicated operation for changing only the rotation of the autostereoscopic display surface without changing the camera direction. Then, when the operating device 26c accepts the dedicated operation, the image processing unit 12a rotates the autostereoscopic display surface based on the dedicated operation without changing the camera direction by the camera control device 26d. good.

<Embodiment 3>
FIG. 21 is a block diagram showing the configuration of the display control device 1 according to the third embodiment of the present invention. Hereinafter, among the components according to the third embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

In the third embodiment, instead of the left rear side camera 26a and the right rear side camera 26b in FIG. 2, the left rear side wide-angle camera 26e and the right rear side wide-angle camera 26f are used in the own vehicle. It is provided. Here, each of the left rear side wide-angle camera 26e and the right rear side wide-angle camera 26f is not a standard camera but a wide-angle camera.

FIG. 22 is a diagram showing a shooting area R1 which is an area where a standard camera having an angle of view of 10 degrees can shoot and a shooting area R2 which is a region where a wide-angle camera having an angle of view of 30 degrees can shoot. Is. FIG. 23 is a diagram corresponding to FIG. 22, and is a diagram showing an example of an image taken by a wide-angle camera. As shown in FIGS. 22 and 23, the shooting area R2 of the wide-angle camera is wider than the shooting area R1 of the standard camera.

Returning to FIG. 21, the operating device 26c accepts a cutting operation for cutting a part of the image captured by the left rear side wide-angle camera 26e. The camera control device 26d may be referred to as a partial image (hereinafter, referred to as “left partial image”) from an image taken by the left rear side wide-angle camera 26e based on the cutting operation received by the operation device 26c. ) Is cut out. The left partial image is, for example, an image in the broken line frame 27 of FIG. Then, the camera control device 26d outputs the left partial image to the display control device 1. Further, the camera control device 26d outputs the range of the left partial image in the entire range of the image captured by the left rear side wide-angle camera 26e to the display control device 1.

Similarly, the operating device 26c accepts a cutting operation for cutting out a part of the image taken by the right rear side wide-angle camera 26f. The camera control device 26d may be referred to as a partial image (hereinafter, referred to as “right partial image”) from the image taken by the right rear side wide-angle camera 26f based on the cutting operation received by the operation device 26c. ) Is cut out. Then, the camera control device 26d outputs the right partial image to the display control device 1. Further, the camera control device 26d outputs the range of the right partial image in the entire range of the image captured by the right rear side wide-angle camera 26f to the display control device 1.

The image acquisition unit 11a according to the third embodiment acquires the left partial image from the camera control device 26d as a captured image, and acquires the right partial image from the camera control device 26d as a captured image.

The display surface generation information acquisition unit 11b obtains a virtual shooting direction of the left partial image as a shooting direction which is a direction related to the captured image, based on the range of the left partial image from the camera control device 26d. In the third embodiment, as shown in FIG. 23, the display surface generation information acquisition unit 11b is the right end of the range of the left partial image with reference to the right end of the image taken by the left rear side wide-angle camera 26e. The angle corresponding to the position is obtained as the virtual shooting direction of the left partial image. In this case, the virtual shooting direction of the left partial image is a horizontal angle as in the left camera direction of the second embodiment.

Similarly, the display surface generation information acquisition unit 11b obtains the virtual shooting direction of the right partial image as the shooting direction which is the direction related to the shot image, based on the range of the right partial image from the camera control device 26d.

In the operation of the image processing unit 12a according to the second embodiment, the image processing unit 12a sets the left camera image, the right camera image, the left camera direction, and the right camera direction as virtual images of the left partial image, the right partial image, and the left partial image. Performs the same operation as the operation of replacing the shooting direction and the virtual shooting direction of the right partial image. That is, in the third embodiment, the virtual shooting direction of the left partial image and the virtual shooting direction of the right partial image are used as the display surface generation information described in the first embodiment.

<Summary of Embodiment 3>
In the display control device 1 according to the third embodiment as described above, the partial image and the virtual shooting direction are used instead of the camera image and the camera direction described in the second embodiment. According to such a configuration, the rotation of the autostereoscopic display surface can be controlled without using the camera directions of the left posterior wide-angle camera 26e and the right posterior wide-angle camera 26f. As a result, hardware such as an electric drive mechanism that changes the direction of the camera becomes unnecessary, and cost reduction can be expected.

<Modified Example of Embodiment 3>
In the third embodiment, the virtual photographing direction of the left partial image, the virtual photographing direction of the right partial image, and the rotation angle of the naked-eye stereoscopic display surface are the directions and angles corresponding to the horizontal angles. However, the virtual shooting direction of the left partial image, the virtual shooting direction of the right partial image, and the rotation angle of the autostereoscopic display surface correspond to the elevation / depression angle as in the modified examples 4 and 5 of the second embodiment. It may be a direction and an angle.

<Embodiment 4>
FIG. 24 is a block diagram showing the configuration of the display control device 1 according to the fourth embodiment of the present invention. Hereinafter, among the components according to the fourth embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

In the third embodiment of FIG. 21, the camera control device 26d generates a left partial image and a right partial image based on the cutting operation received by the operating device 26c, and displays the left partial image and the right partial image. Output to 1. On the other hand, in the fourth embodiment, the display control device 1 is configured to generate a left partial image and a right partial image based on the cutting operation received by the operating device 26c.

The display surface generation information acquisition unit 11b acquires the cutting operation received by the operation device 26c.

The camera control device 26d outputs an image taken by the left rear side wide-angle camera 26e and an image taken by the right rear side wide-angle camera 26f to the display control device 1.

The image acquisition unit 11a acquires an image from the camera control device 26d, that is, an image taken by the left rear side wide-angle camera 26e and an image taken by the right rear side wide-angle camera 26f. Then, the image acquisition unit 11a cuts out a part of the image captured by the left rear side wide-angle camera 26e acquired by the display surface generation information acquisition unit 11b, and the left rear side wide-angle camera 26e The left partial image, which is a part of the image, is cut out from the image taken in. Similarly, the image acquisition unit 11a is based on a cutting operation of cutting out a part of the image captured by the right rear side wide-angle camera 26f acquired by the display surface generation information acquisition unit 11b. A part of the right partial image is cut out from the image taken at 26f. As described above, the image acquisition unit 11a acquires the left partial image and the right partial image as captured images.

The display surface generation information acquisition unit 11b sets the virtual shooting direction of the left partial image as the shooting direction of the shot image based on the range of the left partial image in the entire range of the image shot by the left rear side wide-angle camera 26e. Ask as. Similarly, the display surface generation information acquisition unit 11b sets the virtual shooting direction of the right partial image as the direction with respect to the captured image based on the range of the right partial image in the entire range of the image captured by the right rear side wide-angle camera 26f. Obtained as the barrel shooting direction.

The video processing unit 12a performs the same operation as that of the video processing unit 12a according to the third embodiment. That is, in the fourth embodiment, the virtual shooting direction of the left partial image and the virtual shooting direction of the right partial image are used as the display surface generation information described in the first embodiment. The virtual shooting direction of the left partial image, the virtual shooting direction of the right partial image, and the rotation angle of the naked-eye stereoscopic display surface may be a direction and an angle corresponding to a horizontal angle, and correspond to an elevation / depression angle. It may be a direction and an angle.

<Summary of Embodiment 4>
In the display control device 1 according to the fourth embodiment as described above, the partial image and the virtual shooting direction are used instead of the camera image and the camera direction described in the second embodiment. According to such a configuration, the rotation of the autostereoscopic display surface can be controlled without using the camera directions of the left posterior wide-angle camera 26e and the right posterior wide-angle camera 26f. As a result, hardware such as an electric drive mechanism that changes the direction of the camera becomes unnecessary, and cost reduction can be expected.

<Embodiment 5>
The block diagram showing the configuration of the display control device 1 according to the fifth embodiment of the present invention is the same as the block diagram (FIG. 2) of the display control device 1 according to the second embodiment. Hereinafter, among the components according to the fifth embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

In the fifth embodiment, the display surface generation information acquisition unit 11b acquires the speed of the own vehicle from an ECU (Electronic Control Unit) and an in-vehicle LAN (Local Area Network) of the own vehicle (not shown).

The image processing unit 12a controls the position of the autostereoscopic display surface in the depth direction of the autostereoscopic display based on the speed of the own vehicle. In the fifth embodiment, the image processing unit 12a increases the distance zl in the depth direction shown in FIGS. 25 and 26 as the speed of the own vehicle increases, so that the left naked-eye stereoscopic display surface SL is displayed in the depth direction. Controls the movement to the back side of. Similarly, the image processing unit 12a sets the right autostereoscopic display surface SR to the back side in the depth direction by increasing the distance zr in the depth direction shown in FIGS. 25 and 26 as the speed of the own vehicle increases. Control to move. That is, in the fifth embodiment, the speed of the own vehicle is used as the display surface generation information described in the first embodiment.

Note that FIG. 25 shows the embodiment in the case where the left camera direction θl1 = left rotation angle θl2 = 0 degrees and the right camera direction θr1 = right rotation angle θr2 = 0 degrees, as in FIG. It is a figure which shows typically the left naked-eye stereoscopic display surface SL and the right naked-eye stereoscopic display surface SR which concerns on 5. FIG. 26 shows the fifth embodiment when the left camera direction θl1 = left rotation angle θl2 ≠ 0 degrees and the right camera direction θr1 = right rotation angle θr2 ≠ 0 degrees, as in FIG. It is a figure which shows typically the left-eye stereoscopic display surface SL and right-handed stereoscopic display surface SR.

<Summary of Embodiment 5>
The display control device 1 according to the fifth embodiment as described above controls the position of the autostereoscopic display surface in the depth direction of the autostereoscopic display based on the display surface generation information. According to such a configuration, the degree of freedom in displaying the autostereoscopic display surface can be increased.

In the above description, the display surface generation information is the speed of the own vehicle. However, for example, the display surface generation information may be the position of the autostereoscopic display surface in the depth direction of the autostereoscopic display specified by the user's operation, or, as will be described later, in advance around the own vehicle. It may be the relative position of the defined object with respect to the own vehicle. Further, the contents described in the fifth embodiment may be applied not only to the second embodiment but also to the third and fourth embodiments.

<Embodiment 6>
FIG. 27 is a block diagram showing the configuration of the display control device 1 according to the sixth embodiment of the present invention. Hereinafter, among the components according to the sixth embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

In the sixth embodiment, the shooting direction of the shot image is automatically changed based on various information such as the situation around the own vehicle, and the rotation of the autostereoscopic display surface is also automatically changed accordingly. It is configured to be.

The captured image includes the camera image described in the second embodiment, the partial image described in the third and fourth embodiments, and the like, and the shooting direction of the captured image is described in the second embodiment. The camera direction and the virtual shooting direction of the partial image described in the third and fourth embodiments are included. Hereinafter, in the sixth embodiment, the captured image will be the camera image described in the second embodiment, and the shooting direction of the captured image will be described as the camera direction described in the second embodiment.

The configuration of FIG. 27 is the same as the configuration in which the image recognition processing unit 12c is added to the configuration of FIG. The concept of the image recognition processing unit 12c is a concept included in the control unit 12 of FIG.

The image recognition processing unit 12c acquires the situation around the own vehicle from the photographed image by performing image recognition processing on the photographed image acquired by the image acquisition unit 11a. For example, when another vehicle around the own vehicle is present in the captured image, the image recognition processing unit 12c obtains the width of a portion of the road such as the lane shown in the captured image where the other vehicle is located. Then, the image recognition processing unit 12c obtains the distance between the own vehicle and the other vehicle based on the width. At this time, the image recognition processing unit 12c may obtain the distance between the own vehicle and another vehicle by using the map information having the lane width data. The distance between the own vehicle and another vehicle obtained in this way is a concept included in the situation around the own vehicle.

The camera control device 26d controls the shooting direction of the shot image based on the situation around the own vehicle acquired by the image recognition processing unit 12c.

FIG. 28 is a flowchart showing the operation of the display control device 1 according to the sixth embodiment. This operation is started, for example, when the accessory power of the own vehicle is turned on, or when the drive source of the own vehicle is turned on, and is performed on each of the left and right electronic mirrors.

First, in step S11, the display surface generation information acquisition unit 11b acquires the shooting direction of the shot image.

In step S12, the image acquisition unit 11a acquires a captured image.

In step S13, the image recognition processing unit 12c acquires the situation around the own vehicle from the photographed image by performing image recognition processing on the photographed image acquired by the image acquisition unit 11a.

In step S14, the camera control device 26d determines whether or not to change the shooting direction of the shot image based on the situation around the own vehicle acquired by the image recognition processing unit 12c. For example, the situation around the own vehicle is such that the distance between the own vehicle and another vehicle traveling in the adjacent lane adjacent to the lane in which the own vehicle is traveling is a predetermined distance (for example, 20 m) or less. In the situation, the camera control device 26d determines that the shooting direction of the shot image should be changed. If it is determined that the shooting direction of the captured image should be changed, the process proceeds to step S15, and if it is not determined that the shooting direction of the captured image should be changed, the process proceeds to step S16.

In step S15, the camera control device 26d changes the shooting direction of the shot image. For example, the camera control device 26d changes the shooting direction of the captured image so that the center of the captured image approaches another vehicle traveling in the adjacent lane and the distance to the own vehicle is less than or equal to a predetermined distance. do. After that, the process proceeds to step S17.

In step S16, the camera control device 26d maintains the shooting direction of the shot image in the initial direction. However, if the shooting direction of the captured image is not the initial direction, the camera control device 26d changes the shooting direction of the captured image to the initial direction. After that, the process proceeds to step S17.

In step S17, the image processing unit 12a determines the rotation angle of the autostereoscopic display surface with the naked eye based on the photographing direction of the captured image.

In step S18, the image processing unit 12a generates images for the left eye and the right eye for displaying the autostereoscopic display surface by performing image processing on the captured image based on the rotation angle.

In step S19, the image output unit 12b outputs the video signals of the images for the left eye and the right eye for displaying the autostereoscopic display surface to the display device 21. After that, the process returns to step S11.

<Summary of Embodiment 6>
In the display control device 1 according to the sixth embodiment as described above, the shooting direction of the shot image is automatically changed based on the situation around the own vehicle. According to such a configuration, it is possible to emphasize the object that the driver should pay attention to, so that the convenience for the driver can be enhanced.

In the above description, the captured image is the camera image described in the second embodiment, and the shooting direction of the captured image is the camera direction described in the second embodiment. However, the captured image may be the partial image described in the third and fourth embodiments, and the shooting direction of the captured image may be the virtual shooting direction of the partial image described in the third and fourth embodiments. .. Further, instead of the camera control device 26d, the display surface generation information acquisition unit 11b may control the shooting direction of the captured image based on the situation around the own vehicle acquired by the image recognition processing unit 12c.

<Modification 1 of Embodiment 6>
In the sixth embodiment, the situation around the own vehicle is the distance between the own vehicle and another vehicle. However, if, for example, a detection device such as an optical sensor, a millimeter-wave radar, a high-precision image recognition device, or an ultrasonic sensor detects the relative position of another vehicle with respect to the own vehicle, the situation around the own vehicle may be determined. It may be a position relative to the own vehicle of another vehicle.

<Modification 2 of Embodiment 6>
In the sixth embodiment, the shooting direction of the shot image is automatically changed based on the situation around the own vehicle, but the shooting direction is not limited to this. For example, the shooting direction of the captured image may be automatically changed based on the traveling condition of the own vehicle including the speed of the own vehicle. Specifically, as the speed of the own vehicle increases, the shooting direction of the captured image may be changed so that the center of the captured image approaches the rearmost portion of the road of the own vehicle.

<Modification 3 of Embodiment 6>
Further, the shooting direction of the shot image may be automatically changed based on the shape of the road on which the own vehicle is traveling. For example, when the shape of the road on which the own vehicle is traveling is a curved shape, the shooting direction of the shot image is changed so that the center of the shot image approaches the rearmost part of the road of the own vehicle. May be good.

<Modification 4 of Embodiment 6>
Further, the shooting direction of the shot image may be automatically changed based on the right / left turn situation of the own vehicle. For example, when the own vehicle turns left, the center of the captured image moves from the rear side of the own vehicle to the left side, and when the own vehicle turns right, the captured image is moved from the rear side of the own vehicle to the right side. The shooting direction of the captured image may be changed so that the center of the image moves.

<Modification 5 of Embodiment 6>
In the sixth embodiment and the modified examples 1 to 4 of the sixth embodiment, the shooting directions of the captured images are the situation around the own vehicle, the running situation of the own vehicle, the shape of the road on which the own vehicle is traveling, and the own. It was changed based on one of the vehicle's right and left turn situations. Then, in conjunction with the change in the shooting direction of the shot image, the rotation angle of the autostereoscopic display surface was also changed.

However, the shooting direction of the captured image is changed based on at least one of the situation around the own vehicle, the running situation of the own vehicle, the shape of the road on which the own vehicle is traveling, and the right / left turn situation of the own vehicle. May be done. That is, the display surface generation information is configured to include at least one of the situation around the own vehicle, the running situation of the own vehicle, the shape of the road on which the own vehicle is traveling, and the right / left turn situation of the own vehicle. May be done.

In addition, the shooting direction of the captured image is changed based on at least one of the situation around the own vehicle, the running situation of the own vehicle, the shape of the road on which the own vehicle is traveling, and the right / left turn situation of the own vehicle. Instead, the rotation angle of the autostereoscopic display surface may be changed.

<Embodiment 7>
The block diagram showing the configuration of the display control device 1 according to the seventh embodiment of the present invention is the same as the block diagram (FIG. 2) of the display control device 1 according to the second embodiment. Hereinafter, among the components according to the seventh embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

In the explanation so far, the autostereoscopic display surface is one surface. However, in the seventh embodiment, the autostereoscopic display surface is configured to include a plurality of surfaces. In the seventh embodiment, the rotation of the autostereoscopic display surface as in the second embodiment is not essential.

FIG. 29 is a diagram schematically showing a stereoscopic display surface for the naked eye according to the seventh embodiment. In the following figure, only the part related to the left naked eye stereoscopic display surface SL is shown, but the right naked eye stereoscopic display surface SR is the same as the left naked eye stereoscopic display surface SL.

As shown in FIG. 29, the left autostereoscopic display surface SL is connected to the first surface SL1 inclined from the xz plane and the back side portion of the first surface SL1, is parallel to the xy plane, and is parallel to the xy plane, and the display screen DS. Includes a second surface SL2 with a distance of zl. As shown in FIG. 29, in consideration of perspective, the width of the first surface SL1 may be reduced toward the back side.

FIG. 30 is a diagram showing a specific display example of the display of FIG. 29. The road 5 behind the own vehicle is mainly displayed on the first surface SL1, and the blue sky, clouds, and the like are mainly displayed on the second surface SL2. The boundary between the first surface SL1 and the second surface SL2 may be aligned with the disappearance line of the road 5 based on the image recognition result and the photographing direction of the captured image.

<Summary of Embodiment 7>
In the display control device 1 according to the seventh embodiment as described above, the autostereoscopic display surface includes a plurality of surfaces. According to such a configuration, the display of the electronic mirror can be made to resemble the scenery seen by the driver with the naked eye. The contents described in the seventh embodiment may be appropriately applied not only to the second embodiment but also to the third to sixth embodiments.

<Modification 1 of Embodiment 7>
When the captured image acquired by the image acquisition unit 11a includes a predetermined object, the image processing unit 12a is out of a plurality of surfaces included in the autostereoscopic display surface based on the attributes of the object. The surface on which the object is displayed may be determined, and control for displaying the object on the surface may be performed.

FIG. 31 is a diagram schematically showing a stereoscopic display surface for the naked eye according to the first modification. In the example of FIG. 31, the left autostereoscopic display surface SL includes, in addition to the first surface SL1 and the second surface SL2, a third surface SL3 connected to the front side portion of the first surface SL1 and parallel to the xy plane. I'm out. The position of the third surface SL3 is the same as the position of the display screen DS of the display device 21.

Hereinafter, a case where the object is a body that is a part of the own vehicle 3 will be described. In the first modification, when the captured image acquired by the image acquisition unit 11a includes the body of the own vehicle 3, the image processing unit 12a has the first to third surfaces based on the attribute of the body of the own vehicle 3. The third surface SL3 of SL1 to SL3 is determined as the surface for displaying the body of the own vehicle 3. Then, as shown in FIG. 31, the video processing unit 12a controls to display the body of the own vehicle 3 on the third surface SL3.

With such a configuration, the display of the electronic mirror can be made more similar to the scenery seen by the driver with the naked eye. It should be noted that the plurality of surfaces included in the left autostereoscopic display surface SL do not need to be connected to each other. For example, as shown in FIG. 32, the plurality of surfaces included in the left autostereoscopic display surface SL may be the second surface SL2 and the third surface SL3 separated from each other.

<Modification 2 of Embodiment 7>
The display surface generation information may include object information regarding the relative position of a predetermined object around the own vehicle with respect to the own vehicle. Predetermined objects around the own vehicle are, for example, other vehicles around the own vehicle, features, and the like. The object information may be, for example, the relative position itself of another vehicle around the own vehicle obtained by a peripheral detection device provided outside the display control device 1, or image recognition of an image taken by each camera. It may be the distance between the own vehicle and another vehicle obtained by.

Based on the object information as described above, the image processing unit 12a may control the position of the surface displaying the object among the plurality of surfaces in the depth direction of the autostereoscopic display. At this time, the surface on which the object is displayed among the plurality of surfaces may be determined in the same manner as in the first modification of the seventh embodiment, for example.

FIG. 33 is a diagram schematically showing a stereoscopic display surface for the naked eye according to the second modification. In the example of FIG. 33, the left autostereoscopic display surface SL includes a fourth surface SL4 parallel to the xy plane in addition to the first surface SL1 and the second surface SL2. The position of the fourth surface SL4 is different from the position of the display screen DS of the display device 21.

FIG. 34 is a diagram showing a specific display example of the display of FIG. 29. Hereinafter, the case where the object information is the relative position itself of the other vehicle 6 around the own vehicle will be described. In the second modification, when the captured image acquired by the image acquisition unit 11a includes another vehicle 6 as shown in FIG. 34, the image processing unit 12a has the first and first first based on the attribute of the other vehicle 6. The fourth surface SL4 of the second and fourth surfaces SL1, SL2, SL4 is determined as the surface on which the other vehicle 6 is displayed. Then, as shown in FIG. 33, the image processing unit 12a controls the distance ozl between the fourth surface SL4 and the display screen DS of the display device 21 based on the relative position of the other vehicle 6 around the own vehicle. .. By performing such control, the image processing unit 12a controls the position of the fourth surface SL4 displaying the other vehicle 6 in the depth direction of the autostereoscopic display.

With such a configuration, the display of the electronic mirror can be made more similar to the scenery seen by the driver with the naked eye.

<Modification 3 of Embodiment 7>
The displays described above may be combined as appropriate. For example, as shown in FIG. 35, the display of FIG. 32 and the display of FIG. 33 may be combined. That is, the first surface SL1 may be removed from the left autostereoscopic display surface SL of FIG. 33. Further, for example, as shown in FIG. 36, the display of FIG. 31 and the display of FIG. 33 may be combined. That is, the left autostereoscopic display surface SL may include the first surface SL1 to the fourth SL4. Note that FIG. 37 is a diagram showing a specific display example of the display of FIG. 36.

<Modification 4 of Embodiment 7>
In the second modification of the seventh embodiment, the objects are a part of the own vehicle 3, another vehicle 6, and the like. However, as shown in FIG. 38, it may be an alarm mark displayed on the fifth surface SL5 of the left autostereoscopic display surface SL, or it may be a display object other than that.

<Modification 5 of Embodiment 7>
In the seventh embodiment, it has been explained that the rotation of the autostereoscopic display surface as in the second embodiment is not essential, but of course, the rotation may be performed as appropriate.

As shown in FIG. 39, when the left rotation angle θ of the left autostereoscopic display surface SL is larger than 0, the image on the left side outside the left electron mirror becomes the image on the right side inside the left electron mirror. Compared to the back side, the distance to the driver is relatively large. Here, in general, the larger the distance between a person and an object, the smaller the size of the object as seen by the person.

Therefore, the image processing unit 12a may distort or cut the length of the captured image IM in the vertical direction so as to decrease toward the outside (from the right side to the left side) of the captured image IM. Then, the image processing unit 12a may control to display the captured image IM obtained by distorting or cutting it on the left autostereoscopic display surface SL whose left rotation angle is larger than 0. .. As shown in FIG. 40, the present modification 5 may be applied even when the left autostereoscopic display surface SL includes a plurality of surfaces.

<Modification 6 of Embodiment 7>
In the seventh embodiment, instead of the left rear side camera 26a and the right rear side camera 26b as in the third embodiment, the left rear side wide-angle camera 26e and the right rear side wide-angle camera 26f are used. It may be provided in the own vehicle. In this case, each of the left camera image and the right camera image is a horizontally long image.

Further, when the camera image acquired by the image acquisition unit 11a is a horizontally long image, the image processing unit 12a divides the horizontally long image into a plurality of images arranged in the horizontal direction, and the plurality of images are arranged in the horizontal direction. The image may be distributed and displayed on a plurality of surfaces included in the autostereoscopic display surface.

FIG. 41 is a diagram schematically showing a stereoscopic display surface for the naked eye according to the sixth modification. In the example of FIG. 41, the left autostereoscopic display surface SL includes the sixth surface SL6 and the seventh surface SL7. Here, the size of the sixth side SL6 corresponds to the size of the image taken by a standard camera (hereinafter referred to as "standard size"), and the total size of the sixth side SL6 and the seventh side SL7 is a wide angle. Corresponds to the size of the image taken by the camera.

In the sixth modification, the image processing unit 12a divides the horizontally long image taken by the left rear side camera 26a into a standard size image and a rest image which is another image. Then, the image processing unit 12a controls to display the standard size image on the sixth surface SL6 and controls to display the remaining image on the seventh surface SL7. Note that FIG. 42 is a diagram showing a specific display example of the display of FIG. 42. The image processing unit 12a performs the same control as the control for the horizontally long image taken by the right rear side camera 26b with respect to the horizontally long image taken by the right rear side camera 26b.

According to such a configuration, the driver can distinguish between a range close to the own vehicle and a range far from the own vehicle at a glance, and can drive comfortably.

<Modification 7 of Embodiment 7>
In the sixth modification of the seventh embodiment, the image processing unit 12a divides the camera image. However, the image processing unit 12a may divide a composite image including an image of the left rear of the own vehicle, an image of the right rear, and an image between the left rear and the right rear. In the following description, the image between the left rear and the right rear is referred to as a "right rear image".

As shown in FIG. 43, in the present modification 7, in addition to the left rear side wide-angle camera 26e and the right rear side wide-angle camera 26f, the own vehicle 3 is provided with a rear camera 26g capable of capturing a rear image. ing.

The camera control device 26d synthesizes the left camera image and the right camera image taken by the left rear side wide-angle camera 26e and the right rear side wide-angle camera 26f, respectively, and the right rear image taken by the rear camera 26g. To generate a composite image. Then, the camera control device 26d outputs the generated composite image to the display control device 1. The image acquisition unit 11a acquires a composite image from the camera control device 26d as a captured image.

44 and 45 are views schematically showing the autostereoscopic display surface according to the present modification 7. In the examples of FIGS. 44 and 45, the naked-eye stereoscopic display surface ST1 corresponding to the maximum range that the display device 21 can display is the left naked-eye stereoscopic display surface SL, the right naked-eye stereoscopic display surface SR, and the left naked-eye stereoscopic display surface. It includes a central autostereoscopic display surface SC connected to the visual display surface SL and the right autostereoscopic display surface SR. Here, the sizes of the left autostereoscopic display surface SL and the right autostereoscopic display surface SR correspond to the sizes of the images taken by the left rear side wide-angle camera 26e and the right rear side wide-angle camera 26f.

The image processing unit 12a uses the horizontally long composite image acquired by the image acquisition unit 11a as a left camera image (image of the left rear of the own vehicle), a right camera image (image of the right rear of the own vehicle), and true. Divide into a rear image (an image between the left rear and the right rear). Then, the image processing unit 12a controls to display the left camera image on the left autostereoscopic display surface SL, controls to display the right camera image on the right autostereoscopic display surface SR, and displays the rear image directly to the center naked eye. Controls the display on the stereoscopic display surface SC.

According to such a configuration, it is possible to distinguish at a glance which part of the autostereoscopic display surface ST1 corresponds to the left rear, the right rear direction, or the right rear of the own vehicle, which is comfortable. Can perform various driving.

The image processing unit 12a does not have to control the display device 21 to display all of the autostereoscopic display surface ST1 corresponding to the maximum range that the display device 21 can display. For example, the image processing unit 12a may control the display device 21 to display the partial autostereoscopic display surface ST2, which is a part of the autostereoscopic display surface ST1, based on the operation received by the operation device 26c. ..

Further, the shape of the top view of the autostereoscopic display surface ST1 is such that the central autostereoscopic display surface SC is in front of the left autostereoscopic display surface SL and the right autostereoscopic display surface SR as shown in FIG. Alternatively, the shape shown in FIG. 44 may be an inverted shape corresponding to the Z-axis direction. Further, the shape of the top view of the autostereoscopic display surface ST1 may be V-shaped or Λ-shaped. Further, the left camera image and the right camera image may be displayed on the autostereoscopic display surface ST1 having a V-shape or a Λ-shape without displaying the rear image.

<Other variants>
The acquisition unit 11 and the control unit 12 of FIG. 1 described above are hereinafter referred to as “acquisition unit 11 and the like”. The acquisition unit 11 and the like are realized by the processing circuit 81 shown in FIG. That is, the processing circuit 81 has an acquisition unit 11 that acquires one photographed image around the vehicle and display surface generation information for generating an autostereoscopic display surface, and a photographed image and display acquired by the acquisition unit 11. A control unit 12 that controls the display of a captured image on a stereoscopic display surface for naked eyes based on the surface generation information is provided. Dedicated hardware may be applied to the processing circuit 81, or a processor that executes a program stored in the memory may be applied. Examples of the processor include a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), and the like.

When the processing circuit 81 is dedicated hardware, the processing circuit 81 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate). Array), or a combination of these. Each of the functions of each part such as the acquisition unit 11 may be realized by a circuit in which processing circuits are dispersed, or the functions of each part may be collectively realized by one processing circuit.

When the processing circuit 81 is a processor, the functions of the acquisition unit 11 and the like are realized by combining with software and the like. The software and the like correspond to, for example, software, firmware, or software and firmware. The software or the like is described as a program and stored in the memory 83. As shown in FIG. 47, the processor 82 applied to the processing circuit 81 realizes the functions of each part by reading and executing the program stored in the memory 83. That is, when the display control device 1 is executed by the processing circuit 81, the step of acquiring one captured image around the own vehicle and the display surface generation information for generating the autostereoscopic display surface with the naked eye, and the acquisition. Based on the captured image and the display surface generation information, the step of controlling the display of the captured image on the autostereoscopic display surface and the memory 83 for storing the program to be executed as a result are stored. Be prepared. In other words, it can be said that this program causes the computer to execute the procedure or method of the acquisition unit 11 or the like. Here, the memory 83 is a non-volatile or non-volatile memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EEPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory). Volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), its drive device, etc., or any storage medium used in the future. You may.

The configuration in which each function of the acquisition unit 11 and the like is realized by either hardware or software has been described above. However, the present invention is not limited to this, and a configuration may be configured in which a part of the acquisition unit 11 or the like is realized by dedicated hardware and another part is realized by software or the like. For example, the acquisition unit 11 realizes its function by a processing circuit 81 as dedicated hardware and a receiver, and other than that, the processing circuit 81 as a processor 82 reads and executes a program stored in the memory 83. By doing so, it is possible to realize the function.

As described above, the processing circuit 81 can realize each of the above-mentioned functions by hardware, software, or a combination thereof.

Further, the display control device 1 described above is at least one of a navigation device such as a PND (Portable Navigation Device), a communication terminal including a mobile terminal such as a mobile phone, a smartphone and a tablet, and a navigation device and a communication terminal. It can also be applied to a display control system constructed as a system by appropriately combining the functions of the application to be installed and the server. In this case, each function or each component of the display control device 1 described above may be dispersedly arranged in each device for constructing the system, or may be centrally arranged in any of the devices. good. For example, the display control device may be incorporated in the display device 21 of FIG.

FIG. 48 is a block diagram showing the configuration of the server 91 according to this modification. The server 91 of FIG. 48 includes a communication unit 91a and a control unit 91b, and can perform wireless communication with the navigation device 93 of the vehicle 92.

The communication unit 91a, which is an acquisition unit, receives one photographed image around the vehicle 92 and display surface generation information by performing wireless communication with the navigation device 93.

The control unit 91b has the same function as the control unit 12 of FIG. 1 when a processor (not shown) of the server 91 or the like executes a program stored in a memory (not shown) of the server 91. That is, the control unit 91b generates a control signal for controlling the display of the photographed image on the autostereoscopic display surface based on the photographed image and the display surface generation information received by the communication unit 91a. The communication unit 91a transmits the control signal to the navigation device 93. According to the server 91 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

FIG. 49 is a block diagram showing the configuration of the communication terminal 96 according to this modification. The communication terminal 96 of FIG. 49 includes a communication unit 96a similar to the communication unit 91a and a control unit 96b similar to the control unit 91b, and can perform wireless communication with the navigation device 98 of the vehicle 97. ing. The communication terminal 96 is, for example, a mobile terminal such as a mobile phone, a smartphone, or a tablet carried by the driver of the vehicle 97. According to the communication terminal 96 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

In the present invention, each embodiment and each modification can be freely combined, and each embodiment and each modification can be appropriately modified or omitted within the scope of the invention.

Although the present invention has been described in detail, the above description is exemplary in all embodiments and the present invention is not limited thereto. It is understood that innumerable variations not illustrated can be assumed without departing from the scope of the present invention.

1 Display control device, 3 own vehicle, 11 acquisition unit, 12 control unit, 21 display device, SL left autostereoscopic display surface, SR right autostereoscopic display surface.

Claims (17)

A display control device that controls a display device installed in a vehicle.
The display device is capable of autostereoscopic display by displaying images for the left eye and the right eye.
And one shot image around the vehicle, an acquisition unit that acquires the display screen generation information for generating an autostereoscopic display surface is a surface on the autostereoscopic display,
A control unit that controls the display of the photographed image on the autostereoscopic display surface based on the photographed image acquired by the acquisition unit and the display surface generation information is provided.
The display surface generation information includes a shooting direction which is a direction with respect to the shot image.
The control unit
A display control device that controls the rotation of the autostereoscopic display surface by associating the imaging direction with the normal direction of the autostereoscopic display surface based on the imaging direction. The display control device according to claim 1.
The photographed image is a partial image which is a part of the image obtained by photographing the periphery of the vehicle.
The shooting direction is
A display control device corresponding to the range of the partial image in the range of the image obtained by photographing the periphery of the vehicle. The display control device according to claim 1.
The display control device whose shooting direction is changed based on an operation from the outside of the display control device. The display control device according to claim 1.
The shooting direction is changed based on at least one of the situation around the vehicle, the traveling condition of the vehicle, the shape of the road on which the vehicle is traveling, and the right / left turning condition of the vehicle. Control device. The display control device according to claim 1.
A display control device in which the amount of rotation of the autostereoscopic display surface is different from the amount of change in the angle in the photographing direction. The display control device according to claim 1.
The control unit
A display control device that rotates the autostereoscopic display surface with the naked eye when the difference between the imaging direction and the reference direction of the imaging direction is equal to or greater than a predetermined threshold value. The display control device according to claim 1.
The autostereoscopic display surface is a display control device including a flat surface or a curved surface. A display control device that controls a display device installed in a vehicle.
The display device is capable of autostereoscopic display by displaying images for the left eye and the right eye.
And one shot image around the vehicle, an acquisition unit that acquires the display screen generation information for generating an autostereoscopic display surface is a surface on the autostereoscopic display,
A control unit that controls the display of the photographed image on the autostereoscopic display surface based on the photographed image acquired by the acquisition unit and the display surface generation information is provided.
The autostereoscopic display surface includes a curved surface and includes a curved surface.
The display surface generation information includes the shooting direction of the shot image, and includes the shooting direction.
The control unit
A display control device that controls the rotation of the curved surface by associating the photographing direction with the normal direction of a plane including the left side and the right side of the curved surface based on the photographing direction. The display control device according to claim 1 or 8.
The display surface generation information includes at least one of a situation around the vehicle, a running state of the vehicle, a shape of a road on which the vehicle is traveling, and a right / left turn situation of the vehicle. .. The display control device according to claim 1 or 8.
The control unit
A display control device that controls the position of the autostereoscopic display surface in the depth direction of the autostereoscopic display based on the display surface generation information. The display control device according to claim 10.
The display surface generation information includes the speed of the vehicle.
The control unit
A display control device that controls the movement of the autostereoscopic display surface to the back side in the depth direction as the speed increases. The display control device according to claim 1 or 8.
Before SL autostereoscopic display surface includes a first surface and a second surface,
The first surface is a surface inclined obliquely upward with respect to the depth direction of the display screen of the display device from the horizontal direction, and is a surface for displaying at least the road behind the vehicle as the first object. ,
The second surface is a surface parallel to the display screen of the display device and is a surface for displaying the second object.
The control unit
When the attribute of the second object is the scenery above the road, the control of connecting the second surface to the inner side portion of the first surface while keeping the second surface perpendicular to the horizontal direction.
When the attribute of the second object is the body of the vehicle, the control of connecting the second surface to the front side portion of the first surface in a state perpendicular to the horizontal direction.
When the attribute of the second object is another vehicle around the vehicle, the control of the position of the second surface in the depth direction of the naked-eye stereoscopic display based on the relative position of the other vehicle with respect to the vehicle.
A display controller that does at least one of the above. The display control device according to claim 1 or 8.
Before Symbol captured image includes an image of oblong shape,
The naked-eye stereoscopic display surface includes a plurality of surfaces, and includes a plurality of surfaces.
The plurality of surfaces include a parallel surface which is a surface parallel to the display screen of the display device and an inclined surface which is a surface inclined with respect to the parallel surface in the vertical direction.
The control unit
When the captured image acquired by the acquisition unit is a horizontally long image, the horizontally long image is divided into a plurality of images arranged in the horizontal direction, and the plurality of images are divided into the plurality of images. By controlling the display in a distributed manner on the surface, the image in the rearward direction of the vehicle is displayed on the parallel surface among the plurality of images, and the image other than the image in the rearward direction is displayed on the inclined surface. It is the display control device. It is a display control method that controls a display device provided in a vehicle.
The display device is capable of autostereoscopic display by displaying images for the left eye and the right eye.
Get and one captured image around the vehicle, and a display plane generation information for generating an autostereoscopic display surface is a surface on the autostereoscopic display,
Based on the acquired captured image and the display surface generation information, control is performed to display the captured image on the autostereoscopic display surface.
The display surface generation information includes a shooting direction which is a direction with respect to the shot image.
A display control method for controlling the rotation of the stereoscopic display surface with the naked eye by associating the shooting direction with the normal direction of the stereoscopic display surface with the naked eye based on the shooting direction. It is a display control method that controls a display device provided in a vehicle.
The display device is capable of autostereoscopic display by displaying images for the left eye and the right eye.
Get and one captured image around the vehicle, and a display plane generation information for generating an autostereoscopic display surface is a surface on the autostereoscopic display,
Based on the acquired captured image and the display surface generation information, control is performed to display the captured image on the autostereoscopic display surface.
The autostereoscopic display surface includes a curved surface and includes a curved surface.
The display surface generation information includes the shooting direction of the shot image, and includes the shooting direction.
A display control method for controlling the rotation of a curved surface by associating the photographing direction with the normal direction of a plane including the left side and the right side of the curved surface based on the photographing direction. The display control method according to claim 14 or 15.
Before SL autostereoscopic display surface includes a first surface and a second surface,
The first surface is a surface inclined obliquely upward with respect to the depth direction of the display screen of the display device from the horizontal direction, and is a surface for displaying at least the road behind the vehicle as the first object. ,
The second surface is a surface parallel to the display screen of the display device and is a surface for displaying the second object.
When the attribute of the second object is the scenery above the road, the control of connecting the second surface to the inner side portion of the first surface while keeping the second surface perpendicular to the horizontal direction.
When the attribute of the second object is the body of the vehicle, the control of connecting the second surface to the front side portion of the first surface in a state perpendicular to the horizontal direction.
When the attribute of the second object is another vehicle around the vehicle, the control of the position of the second surface in the depth direction of the naked-eye stereoscopic display based on the relative position of the other vehicle with respect to the vehicle.
A display control method that does at least one of the above. The display control method according to claim 14 or 15.
Before Symbol captured image includes an image of oblong shape,
The naked-eye stereoscopic display surface includes a plurality of surfaces, and includes a plurality of surfaces.
The plurality of surfaces include a parallel surface which is a surface parallel to the display screen of the display device and an inclined surface which is a surface inclined with respect to the parallel surface in the vertical direction.
When the acquired captured image is a horizontally long image, the horizontally long image is divided into a plurality of images arranged in the horizontal direction, and the plurality of images are dispersed on the plurality of surfaces. By controlling the display , the image in the rearward direction of the vehicle is displayed on the parallel surface among the plurality of images, and the image other than the image in the rearward direction is displayed on the inclined surface. Control method.

Images