JP2021158540A - Display control device, display control method and program - Google Patents

Abstract

To provide a display control device and the others, by which an image photographed by a camera is suitably displayed.SOLUTION: A display control device 10 includes a photographic data acquisition unit 11, an operating state detection unit 12, an extracted image data generation unit 13, a display image data generation unit 14, and an output unit 15. The photographic data acquisition unit 11 acquires photographic data generated by photographing a landscape outside a vehicle by means of a camera. The operating state detection unit 12 detects an operating state of the vehicle. The extracted image data generation unit 13 generates an extracted image from the photographic data, on the basis of an angle of view set according to the operating state. The display image data generation unit 14 generates, from extracted image data, display image data relating to a display image having a preset image size. The output unit 15 outputs a display image to a display unit having the image size.SELECTED DRAWING: Figure 1

Description

The present invention relates to a display control device, a display control method and a program.

A system that captures the scenery outside the vehicle with an in-vehicle camera and displays the captured image on a monitor inside the vehicle has become widespread. In addition, proposals have been made to connect images taken by an in-vehicle camera to support driving.

For example, the system described in Patent Document 1 displays images of the rear and side regions of a vehicle body on two parts of a monitor screen at different compression rates, and changes the compression rates according to vehicle information.

Japanese Unexamined Patent Publication No. 2016-048839

The image displayed by the above system does not mean that the amount of information of the image itself has increased. On the other hand, there is a demand to increase the amount of image information applied to a desired region according to the operating state of the vehicle. However, the display area cannot be enlarged.

The present invention has been made to solve such a problem, and provides a display control device or the like that preferably displays an image taken by a camera.

The display control device according to the present invention includes a shooting data acquisition unit, an operating state detection unit, an extracted image data generation unit, a display image data generation unit, and an output unit. The shooting data acquisition unit acquires shooting data in which the camera captures the scenery outside the vehicle. The operating state detection unit detects the operating state of the vehicle. The extracted image data generation unit generates an extracted image from the captured data at an angle of view set according to the operating state. The display image data generation unit generates display image data related to a display image having a preset image size from the extracted image data. The output unit outputs a display image to a display unit having an image size.

The display control method according to the present invention includes a shooting data acquisition step, an operating state detection step, an extracted image data generation step, a display image data generation step, and an output step. In the shooting data acquisition step, the camera acquires shooting data of the scenery outside the vehicle. The operating state detection step detects the operating state of the vehicle. The extracted image data generation step generates an extracted image from the captured data at an angle of view set according to the operating state. The display image data generation step generates display image data related to a display image having a preset image size from the extracted image data. The output step outputs a display image to a display unit having an image size.

The program according to the present invention causes a computer to execute a display control method, and the display control method includes a shooting data acquisition step, an operation state detection step, an extracted image data generation step, a display image data generation step, and an output step. have. In the shooting data acquisition step, the camera acquires shooting data of the scenery outside the vehicle. The operating state detection step detects the operating state of the vehicle. The extracted image data generation step generates an extracted image from the captured data at an angle of view set according to the operating state. The display image data generation step generates display image data related to a display image having a preset image size from the extracted image data. The output step outputs a display image to a display unit having an image size.

According to the present invention, it is possible to provide a display control device or the like that suitably displays an image taken by a camera.

It is a block diagram of the display control device which concerns on Embodiment 1. FIG. FIG. 5 is a top view showing a shooting range of a camera in a vehicle equipped with the display control device according to the first embodiment. It is a flowchart of the display control device which concerns on Embodiment 1. FIG. It is a figure which shows the 1st example of the image taken by the left camera. It is a figure which shows the 1st example of the display image displayed on the display part. It is a figure which shows the 2nd example of the image taken by the left camera. It is a figure which shows the 2nd example of the display image displayed on the display part. It is a block diagram of the display control device which concerns on Embodiment 2. FIG. It is a figure which shows the example of the display image which concerns on Embodiment 2. FIG. It is a block diagram of the display control device which concerns on Embodiment 3. FIG. FIG. 5 is a top view showing a shooting range of a camera in a vehicle equipped with the display control device according to the third embodiment. It is a flowchart of the display control device which concerns on Embodiment 3. FIG.

Hereinafter, the present invention will be described through embodiments of the invention, but the inventions in the claims are not limited to the following embodiments. Moreover, not all of the configurations described in the embodiments are indispensable as means for solving the problem. For the sake of clarity, the following description and drawings have been omitted and simplified as appropriate. In each drawing, the same elements are designated by the same reference numerals, and duplicate explanations are omitted as necessary.

<Embodiment 1>
The configuration of the display control device according to the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram of the display control device according to the first embodiment. The display control device 10 shown in FIG. 1 is connected to the camera 91 and the display unit 92, respectively. The display control device 10, the camera 91, and the display unit 92 are mounted on the vehicle.

The camera 91 is mounted at an arbitrary position of the vehicle, photographs the scenery outside the vehicle, and generates photographing data which is the data of the photographed image. The camera 91 generates, for example, 30 frames per second (30 fps) of shooting data, and supplies the generated shooting data to the display control device 10 every 1 / 30th of a second. The shooting data is, for example, H. 264 or H. It may be generated using a method such as 265.

The camera 91 may have a plurality of cameras. The camera 91 in this embodiment includes a left camera 91A, a right camera 91B, and a rear camera 91C. The left camera 91A, the right camera 91B, and the rear camera 91C are image pickup devices each having an objective lens, an image pickup element, an AD (Analog to Digital) conversion element, and the like. The left camera 91A, the right camera 91B, and the rear camera 91C each generate shooting data, and supply the generated shooting data to the display control device 10.

The display unit 92 is a display unit installed so that information can be presented to the driver, and includes, for example, a display unit such as a liquid crystal panel or an organic EL (Electro Luminescence) panel. The display unit 92 is installed at a position such as a dashboard where the driver can visually recognize the display unit. The display unit 92 receives the image data from the display control device 10 and displays the image related to the received image data on the display unit.

The display control device 10 has, for example, an arithmetic unit such as a CPU (Central Processing Unit) or an MCU (Micro Controller Unit). Further, the display control device 10 has at least a control board composed of a flash memory or a non-volatile or volatile memory such as a DRAM (Dynamic Random Access Memory), and other electric circuits in addition to the above arithmetic unit. ing. The display control device 10 has a program incorporated in these arithmetic units and the like, and realizes the functions shown below by combining software or hardware.

The display control device 10 processes the image data related to the image captured by the camera 91, and outputs the processed predetermined image data to the display unit 92. The display control device 10 mainly includes a shooting data acquisition unit 11, an operating state detection unit 12, an extracted image data generation unit 13, a display image data generation unit 14, and an output unit 15. These elements of the display control device 10 are communicably connected by a communication bus.

The shooting data acquisition unit 11 acquires shooting data generated by the camera 91 taking a picture of the scenery outside the vehicle. The shooting data acquisition unit 11 supplies the acquired shooting data to the extracted image data generation unit 13 via the communication bus.

The operation state detection unit 12 detects the operation state of the vehicle and generates the operation state information according to the operation state. Here, the "operating state of the vehicle" means a state of operation related to the movement of the vehicle. That is, in the present embodiment, the operating state of the vehicle is, for example, the moving direction of the vehicle or the moving speed of the vehicle. For example, the operating state detection unit 12 may analyze an image related to the photographing data acquired by the photographing data acquisition unit 11 and detect the operating state of the vehicle from the change in the position of the object included in the analyzed image. The operation state detection unit 12 supplies the operation state information generated as described above to the extracted image data generation unit 13.

The operating state detection unit 12 may be connected to, for example, an acceleration sensor (not shown) and detect the operating state of the vehicle from the change in acceleration acquired from the acceleration sensor. Further, the operation state detection unit 12 is connected to a positioning information receiving unit (not shown) for receiving positioning information for positioning the position of the own vehicle from a satellite positioning system such as GNSS (Global Navigation Satellite System), and receives the positioning information. The operating state of the vehicle may be detected from the change in the position information acquired from the unit.

The extracted image data generation unit 13 receives the shooting data from the shooting data acquisition unit 11. Further, the extracted image data generation unit 13 receives the operation state information from the operation state detection unit 12, and determines the angle of view for generating the extracted image from the received operation state information. More specifically, the extracted image data generation unit 13 according to the present embodiment sets the angle of view according to the moving speed of the vehicle. For example, the extracted image data generation unit 13 sets the first angle of view at the first speed, which is slower than the first speed, to be narrower than the second angle of view at the second speed, which is slower than the first speed.

The extracted image data generation unit 13 extracts an image having an angle of view determined as described above from the captured data, and generates extracted image data related to the image (extracted image) of the extracted region. In this way, the extracted image data generation unit 13 generates an extracted image from the captured data at an angle of view set according to the operating state of the vehicle. The extracted image data generation unit 13 supplies the generated extracted image data to the display image data generation unit 14.

The display image data generation unit 14 receives the extracted image data from the extracted image data generation unit 13, and generates display image data using the received extracted image data. The display image data is data to be output to the display unit 92, and is image data corresponding to the image size of the display unit included in the display unit 92. Here, the "image size of the display unit" means the image size of the area when the display image is displayed in a predetermined area in the display unit instead of the entire display unit. That is, the display image data generation unit 14 generates display image data obtained by converting the extracted image into a preset image size. The process performed by the display image data generation unit 14 on the extracted image includes processes such as enlargement, reduction, decompression, compression, noise removal, and color tone correction. The display image data generation unit 14 supplies the generated display image to the output unit 15.

Specific methods of these processes performed by the display image data generation unit 14 are already known to those skilled in the art. Therefore, although detailed description is omitted here, for example, as a specific embodiment of the method of enlarging or reducing an image, there is stretching or compression of an image. Enlarging or reducing an image changes the distance between a predetermined pixel and surrounding pixels, and interpolates the pixels in between. Further, stretching the image means stretching the image along a predetermined direction. In this case, for the pixels in the stretching direction, the distance between the pixels is widened, and the pixels in between are interpolated. Also, compressing an image means shrinking the image along a predetermined direction. In this case, for the pixels in the shrinking direction, the distance between the pixels is narrowed and the pixels are interpolated as appropriate.

The output unit 15 is an interface for communicably connecting the display control device 10 and the display unit 92. The output unit 15 outputs a display image to a display unit 92 having a preset image size.

Next, an example of the shooting range of the camera in the vehicle will be described with reference to FIG. FIG. 2 is a top view showing a shooting range of a camera in a vehicle equipped with the display control device according to the first embodiment. The vehicle 90 shown in FIG. 2 is an automobile, which is an embodiment as a moving body.

The vehicle 90 has three cameras, a left camera 91A, a right camera 91B, and a rear camera 91C described in FIG. The left camera 91A is installed on the left side of the vehicle 90 and photographs the scenery on the left side of the vehicle 90. The left camera 91A has a shooting angle of view A10 in the horizontal direction indicated by the alternate long and short dash line is 180 degrees. That is, the image taken by the left camera 91A includes a landscape with an angle of view of 180 degrees on the left side of the vehicle 90. The right camera 91B is installed on the right side of the vehicle 90 and photographs the scenery on the right side of the vehicle 90. The right camera 91B has a horizontal shooting angle of view B10 of 180 degrees. Similarly, the rear camera 91C is installed on the back surface of the vehicle 90 and photographs the scenery behind the vehicle 90. The rear camera 91C has a horizontal shooting angle of view C10 of 180 degrees. In the following description, the horizontal angle of view or the horizontal angle of view may be simply referred to as "angle of view".

The solid line extending radially from the left camera 91A to the left rear of the vehicle 90 indicates the angle of view A11 of the extracted image extracted from the image captured by the left camera 91A and the angle of view A12 wider than the angle of view A11. For example, the extracted image data generation unit 13 sets the first angle of view at the first speed of movement to the angle of view A11, and sets the second angle of view at the second speed slower than the first speed to the angle of view A12.

The solid line extending radially from the right camera 91B to the right rear of the vehicle 90 indicates the angle of view B11 of the extracted image extracted from the captured image of the right camera 91B. The solid line extending radially from the rear camera 91C to the rear of the vehicle 90 indicates the angle of view B11 of the extracted image extracted from the captured image of the rear camera 91C.

Next, the process performed by the display control device 10 will be described with reference to FIG. FIG. 3 is a flowchart of the display control device 10 according to the first embodiment. The flowchart shown in FIG. 3 shows the processing of the left camera 91A in the display control device 10 mounted on the vehicle 90 shown in FIG. The flowchart shown in FIG. 3 is started, for example, by activating the main system of the vehicle 90.

First, the shooting data acquisition unit 11 of the display control device 10 acquires shooting data from the left camera 91A (step S10). Next, the operation state detection unit 12 of the display control device 10 determines whether or not the moving speed V of the vehicle 90 is equal to or greater than the threshold value Vth as the operation state of the vehicle 90 (step S11). When it is determined that the moving speed V of the vehicle 90 is equal to or higher than the threshold value Vth (step S11: Yes), the display control device 10 proceeds to step S12. On the other hand, when it is not determined that the moving speed V of the vehicle 90 is equal to or higher than the threshold value Vth (step S11: No), the display control device 10 proceeds to step S13.

In step S12, the extracted image data generation unit 13 of the display control device 10 sets the angle of view A of the extracted image to the angle of view A11 (step S12). Then, the display control device 10 proceeds to step S14.

In step S13, the extracted image data generation unit 13 of the display control device 10 sets the angle of view A of the extracted image to the angle of view A12 (step S13). Then, the display control device 10 proceeds to step S14.

That is, the threshold value Vth is a condition for the extracted image data generation unit 13 to set the angle of view. Further, the threshold value Vth may be arbitrarily changed by using a terminal device connected to the display control device 10 (not shown) depending on the weather conditions.

In step S14, the extracted image data generation unit 13 of the display control device 10 generates the extracted image data according to the set angle of view (step S14). That is, when the moving speed V of the vehicle is equal to or higher than the threshold value Vth, the extracted image data generation unit 13 generates the extracted image data related to the extracted image at the angle of view A11. On the other hand, when the moving speed V of the vehicle is not equal to or higher than the threshold value Vth, the extracted image data generation unit 13 generates the extracted image data related to the extracted image having the angle of view A12 wider than the angle of view A11. When the extracted image data generation unit 13 generates the extracted image data, the extracted image data generation unit 13 supplies the generated extracted image data to the display image data generation unit 14.

Next, the display image data generation unit 14 of the display control device 10 generates display image data from the extracted image data received from the extracted image data generation unit 13 (step S15), and outputs the generated display image data to the output unit 15. Supply. Specifically, when the threshold value is Vth or more, the image size of the display image data is generated as it is, and when the threshold value is not Vth or more, the pixels of the display image data are compressed and generated.

Next, the output unit 15 of the display control device 10 outputs the display image data received from the display image data generation unit 14 to the display unit 92 (step S16).

Next, the display control device 10 determines whether or not to end a series of processes (step S17). The case of terminating a series of processes is, for example, a case where the system is stopped or a case where the process is terminated by the operation of the driver. If it is not determined to end the series of processes (step S17: No), the display control device 10 returns to step S10 and continues the process. When it is determined to end the series of processing (step S17: Yes), the display control device 10 ends the processing.

By the above processing, the display control device 10 sets the angle of view of the extracted image according to the moving speed of the vehicle 90. The above description shows the processing of the left camera 91A as an example, but of course, the above processing is also applied to the processing of the right camera 91B or the rear camera 91C.

Next, an example of an image taken by the left camera 91A will be described with reference to FIG. FIG. 4 is a diagram showing a first example of an image taken by the left camera 91A. The image P10 shown in FIG. 4 is a photograph of the landscape on the left side of the vehicle 90 by the left camera 91A. The right side of the image P10 is the landscape on the left front of the vehicle 90, and the left side of the image P10 is the landscape on the left rear of the vehicle 90. A truck and a motorcycle are photographed on the right side of the image P10. That is, a truck and a two-wheeled vehicle exist in front of the left side of the vehicle 90. Further, on the left side of the image P10, another vehicle H1, another vehicle H2, and another vehicle H3 are photographed. That is, other vehicles H1 to H3 exist behind the left rear of the vehicle 90. Since the image P10 is an image taken at a wide angle of view of 180 degrees, it has a predetermined distortion. Therefore, the image included in the image P10 is displayed in a distorted state.

On the left side of the image P10 shown in FIG. 4, the outer edge T11 of the extracted image is indicated by a thick alternate long and short dash line. That is, the extracted image is a region surrounded by the outer edge T11. Here, the outer edge T11 shows an extracted image relating to the above-mentioned angle of view A11. When generating the extracted image data from the shooting data shown in FIG. 4, the extracted image data generation unit 13 sets the angle of view A11 because the moving speed V of the vehicle 90 is Vth or more, and extracts the region indicated by the outer edge T11. do. The area surrounded by the outer edge T11 includes another vehicle H1 and another vehicle H2. Therefore, the extracted image includes the other vehicle H1 and the other vehicle H2.

The outer edge T11 shown in FIG. 4 is distorted so as to correspond to the distortion aberration of the image P10. The display image data generation unit 14 processes the extracted image so that the outer edge T11 becomes rectangular and has the image size of the display image described later.

Next, an example of a display image displayed by the display unit 92 will be described with reference to FIG. FIG. 5 is a diagram showing a first example of a display image displayed on the display unit. FIG. 5 shows the display image P100. The display image P100 includes a left display image P11, a rear display image P12, and a right display image P13.

The left display image P11 is an image generated from the shooting data of the left camera 91A. The rear display image P12 is an image generated from the shooting data of the rear camera 91C. The right display image P13 is an image generated from the shooting data of the right camera 91B. That is, the display image P100 is obtained by appropriately extracting the shooting data generated by the left camera 91A, the right camera 91B, and the rear camera 91C by the extraction image data generation unit 13, and further processing the display image data generation unit 14 as a display image. Are displayed side by side. The left display image P11 is displayed in the area of the width W11 in the display image P100. Further, the rear display image P12 is displayed in the area of the width W12 in the display image P100. Further, the right display image P13 is displayed in the area of the width W13 in the display image P100.

The left display image P11 shown in FIG. 5 is generated from the extracted image data extracted by the outer edge T11 shown in FIG. Therefore, the left display image P11 includes another vehicle H1 and another vehicle H2. As shown in the figure, the display image data generation unit 14 generates the left display image P11 as a substantially distortion-free image from the extracted image data having distortion. In this way, the display image data generation unit 14 generates images of the left display image P11, the rear display image P12, and the right display image P13 included in the display image P100 in a substantially distortion-free state from the respective captured data. To display.

Next, another example of the image captured by the left camera 91A will be described with reference to FIG. FIG. 6 is a diagram showing a second example of an image taken by the left camera. The image P10 shown in FIG. 6 is a photograph of the landscape on the left side of the vehicle 90 by the left camera 91A, similarly to the image shown in FIG. In the image P10 shown in FIG. 6, the outer edge T12 of the extracted image is different from the outer edge T11 shown in FIG.

On the left side of the image P10 shown in FIG. 6, the outer edge T12 is indicated by a thick alternate long and short dash line. The outer edge T12 shows an extracted image relating to the above-mentioned angle of view A12. When generating the extracted image data from the shooting data shown in FIG. 6, the extracted image data generation unit 13 sets the angle of view A12 because the moving speed V of the vehicle 90 is less than Vth, and extracts the region indicated by the outer edge T12. do. The angle of view A12 is wider than the angle of view A11. Therefore, the region surrounded by the outer edge T12 includes the other vehicle H1 and the other vehicle H2 as well as the other vehicle H3. Therefore, the extracted image includes other vehicles H1 to H3. The display image data generation unit 14 processes the extracted image so that the outer edge T12 becomes rectangular and has the image size of the display image described later.

Next, an example of a display image displayed by the display unit 92 will be described with reference to FIG. 7. FIG. 7 is a diagram showing a second example of a display image displayed on the display unit. FIG. 7 shows the display image P101. The display image P101 is different from the image P100 shown in FIG. 5 in that the left display image P14 is provided instead of the left display image P11. The points different from the image P100 will be mainly described below.

The left display image P14 shown in FIG. 7 is generated from the extracted image data extracted by the outer edge T12 shown in FIG. Therefore, the left display image P14 includes the other vehicle H3 in addition to the other vehicle H1 and the other vehicle H2. The width W11 on which the left display image P14 is displayed is the same width W11 as the left display image P11 shown in FIG. That is, the left display image P14 displays an image having an angle of view A12 wider than the angle of view A11 with the same width as the image having an angle of view A11. Therefore, when the left display image P11 and the left display image P14 are compared, the width of the left display image P14 is relatively compressed in the left-right direction. That is, when the moving speed V is less than Vth, the angle of view of the image displayed as the left display image P11 is wider than when the moving speed V is Vth or more. In this way, the display control device 10 can display a wider range of images without enlarging the area of the display unit. Therefore, the display control device 10 can suitably provide driving support to the user.

Although the above description shows the shooting data of the left camera 91A as an example, the above configuration can also be applied to the right camera 91B and the rear camera 91C. Further, the display control device 10 in the present embodiment has the above-mentioned three types of cameras as the cameras 91, but the number of cameras may be one or more. Further, in the above example, the camera 91 includes a fisheye lens, and the image of the captured data has distortion. However, the image captured by the camera 91 is not limited to the above-mentioned one, and may have no distortion. Further, the relationship between the moving speed V of the vehicle and the angle of view A described above is an example, and if the configuration is such that the angle of view of the extracted image data is set according to the operating state of the vehicle, the moving speed V and the image The relationship with the angle A is not limited to the above.

The display image data generation unit 14 may display the extracted image related to the extracted image data by rotating it 90 times with respect to the display unit. For example, converting the extracted image as the left display image P14 into a display image without rotating it is called a first conversion. On the other hand, rotating the extracted image by 90 degrees as the left display image P14 and converting it into a display image is referred to as a second conversion. At this time, when the distortion of the image subjected to the first conversion is larger than the distortion of the image subjected to the second conversion, the display image data generation unit 14 converts the extracted image by the second conversion to generate the display image. It may be. With such a configuration, the display control device 10 can display an image having a suitable angle of view with less distortion.

The first embodiment has been described above. The display control device 10 according to the first embodiment displays an image having a wider angle of view as compared with the case where the image is not compressed by compressing and displaying the image in the left-right direction. Therefore, according to the first embodiment, it is possible to provide a display control device or the like that preferably displays an image taken by the camera.

<Embodiment 2>
Next, the second embodiment will be described. The display control device according to the second embodiment is different from the first embodiment in that it has an index image data generation unit. FIG. 8 is a block diagram of the display control device according to the second embodiment. The display control device 20 shown in FIG. 8 has an index image data generation unit 16.

The index image data generation unit 16 acquires the distortion state of the display image generated by the display image data generation unit 14, and generates an index image according to the acquired distortion state. The "index image data" is data of the "index image" indicating a distorted state of the display image included in the display image data. The index image is configured so that it can be compared with, for example, an image when the display image data generation unit 14 generates an image without distortion.

The index image data generation unit 16 generates index image data including the index image for expressing the distortion of the display image. Then, the index image data generation unit 16 supplies the generated index image data to the display image data generation unit 14. Further, the display image data generation unit 14 generates display image data by superimposing the index image data received from the index image data generation unit 16.

A specific example of the index image will be described with reference to FIG. FIG. 9 is a diagram showing an example of a display image according to the second embodiment. The image P102 shown in FIG. 9 is obtained by superimposing an index image on the image P101 shown in FIG. 7. The index image G14 is superimposed on the upper part of the left display image P14. The index image G12 is superimposed on the upper part of the rear display image P12. The index image G13 is superimposed on the upper part of the right display image P13. By arranging the index images G12 to G14 at the upper part of each image, the display control device 10 suppresses the index image from interfering with the display of other vehicles, roads, and the like.

The index image G12 and the index image G13 each have a circular shape. This means that the post-display image P12 on the index image G12 has no distortion, and the back-display image P13 on the index image G13 has no distortion. On the other hand, the index image G14 has a vertically long ellipse shape that is relatively long in the vertical direction and relatively short in the horizontal direction. The vertical length of this great circle is the same as that of the index image G12 and the index image G13. That is, the index image G14 has a shape that is relatively compressed in the left-right direction as compared with the index image G12 and the index image G13. This indicates that the left display image P14 related to the index image G14 is relatively compressed in the left-right direction. With such a display, the user can intuitively understand how the display image related to the index image is distorted when the index image is visually recognized.

Although the second embodiment has been described above, the index image has the same tendency as the distortion of the displayed image by multiplying the actual distortion by a preset coefficient, but the degree of distortion is different. It may be. As a result, the display control device 20 can generate index image data so that the user can more intuitively understand the distortion state. Further, in the above example, the index image is superimposed on the display image, but the index image may not be superimposed on the display image. For example, when the display image is smaller than the image size of the display unit and there is another display area, the index image may be displayed in the other display area.

The second embodiment has been described above. The display control device 20 according to the second embodiment compresses and displays the left-right direction of the image, and displays an index image indicating that the displayed image is in a compressed and distorted state. Therefore, according to the second embodiment, it is possible to provide a display control device or the like that preferably displays an image taken by the camera.

<Embodiment 3>
Next, the third embodiment will be described. The display control device according to the third embodiment is different from the second embodiment in that the display control device further includes a vehicle information acquisition unit. FIG. 10 is a block diagram of the display control device according to the third embodiment. The display control device 30 shown in FIG. 10 is different from the first embodiment and the second embodiment in that the display control device 30 has the vehicle information acquisition unit 17. Further, the display control device 30 is connected to the ECU 93 (ECU = Electronic Control Unit) of the vehicle 90 via an in-vehicle communication bus such as CAN (Controller Area Network).
The vehicle information acquisition unit 17 is communicably connected to the ECU 93 of the vehicle 90 via the CAN, which is an in-vehicle communication bus, and acquires vehicle information from the ECU 93. The vehicle information is information related to the driving state of the vehicle, for example, the accelerator opening degree, the steering angle of the steering wheel, the operating state of the direction indicator, the position of the shift lever, and the like. Further, the vehicle information may be a combination of the operating state and the moving speed of the vehicle 90. The vehicle information acquisition unit 17 supplies the acquired vehicle information to the operation state detection unit 12.

The operation state detection unit 12 receives vehicle information from the vehicle information acquisition unit 17, and detects the operation state using the received vehicle information. For example, when the direction indicator indicating the left from the vehicle information acquisition unit 17 (hereinafter referred to as the left direction indicator) is in the ON state, the operation state detection unit 12 detects that the vehicle 90 moves to the left. Further, for example, when the left turn signal is on and the moving speed of the vehicle is a cruising speed such as 50 km / h, the operation state detection unit 12 determines that the vehicle 90 changes lanes to the left. To detect. Further, for example, when the left turn signal is on and the moving speed of the vehicle is about 10 km / h, the operation state detection unit 12 indicates that the vehicle 90 is likely to turn left to the left. To detect. The operation state detection unit 12 detects the operation state of the vehicle 90 as described above, and generates the operation state information from the detected operation state. Then, the operation state detection unit 12 supplies the generated operation state information to the extracted image data generation unit 13.

Next, an example of the shooting range of the camera in the vehicle will be described with reference to FIG. FIG. 11 is a top view showing a shooting range of a camera in a vehicle equipped with the display control device according to the third embodiment. The top view of the vehicle 90 shown in FIG. 11 is different from FIG. 2 in that it further has an angle of view A13 of the left camera 91A.

In FIG. 11, the solid line extending radially from the left camera 91A to the left rear of the vehicle 90 is from the angle of view A11 of the extracted image extracted from the image captured by the left camera 91A, the angle of view A12 wider than the angle of view A11, and the angle of view A12. It shows a wide angle of view A13.

For example, the extracted image data generation unit 13 sets the angle of view of the extracted image to the angle of view A11 when the vehicle 90 is traveling straight and the moving speed is the first speed. For example, the extracted image data generation unit 13 sets the angle of view of the extracted image to the angle of view A12 when the left turn signal of the vehicle 90 is on and the moving speed is the first speed. The extracted image data generation unit 13 sets the angle of view of the extracted image to the angle of view A13 when the left turn signal of the vehicle 90 is on and the moving speed is the second speed slower than the first speed.

Next, with reference to FIG. 12, the process executed by the display control device 30 according to the third embodiment will be described. FIG. 12 is a flowchart of the display control device according to the third embodiment. In the flowchart shown in FIG. 12, the processing between steps S10 and S14 is different from the flowchart shown in FIG.

First, the shooting data acquisition unit 11 of the display control device 10 acquires shooting data from the left camera 91A (step S10). Next, the operation state detection unit 12 of the display control device 10 determines whether or not the left turn signal of the vehicle 90 is on as the operation state of the vehicle 90 (step S21). If it is not determined that the left turn signal of the vehicle 90 is on (step S21: No), the display control device 10 proceeds to step S22. On the other hand, when it is determined that the left turn signal of the vehicle 90 is on (step S21: Yes), the display control device 10 proceeds to step S23.

In step S22, the extracted image data generation unit 13 of the display control device 10 sets the angle of view A of the extracted image to the angle of view A11 (step S22). Then, the display control device 10 proceeds to step S14.

In step S23, the operating state detection unit 12 determines whether or not the moving speed V of the vehicle 90 is equal to or greater than the threshold value Vth (step S23). When it is determined that the moving speed V of the vehicle 90 is equal to or higher than the threshold value Vth (step S23: Yes), the display control device 10 proceeds to step S24. On the other hand, when it is not determined that the moving speed V of the vehicle 90 is equal to or higher than the threshold value Vth (step S23: No), the display control device 10 proceeds to step S25.

In step S24, the extracted image data generation unit 13 of the display control device 10 sets the angle of view A of the extracted image to the angle of view A12 (step S24). Then, the display control device 10 proceeds to step S14.

In step S25, the extracted image data generation unit 13 of the display control device 10 sets the angle of view A of the extracted image to the angle of view A13 (step S25). Then, the display control device 10 proceeds to step S14.

Since steps S14 and subsequent steps are the same as the flowchart shown in FIG. 3, description thereof will be omitted here.

By the above-mentioned processing, the display control device 30 sets the angle of view of the extracted image according to the state of the direction indicator of the vehicle 90 and the moving speed of the vehicle 90. The above description shows the processing of the left camera 91A as an example, but of course, the above processing is also applied to the processing of the right camera 91B or the rear camera 91C. Further, the relationship between the angle of view set by the extracted image data generation unit 13 and the operating state is an example for explaining the present embodiment, and the display control device 30 may perform a process different from the above-described process. good.

The display control device 30 according to the third embodiment does not have to have the index image data generation unit 16 as in the first embodiment. In addition to the vehicle information acquired from the ECU 93, the operation state detection unit 12 may use the change in acceleration acquired from the acceleration sensor and the change in the position information of the own vehicle acquired from the satellite positioning system.

The third embodiment has been described above. The display control device 30 according to the third embodiment can set the angle of view of the extracted image according to the driving state of the vehicle 90. Then, the display control device 30 according to the third embodiment compresses and displays the left-right direction of the image, and displays an index image indicating that the displayed image is in a compressed and distorted state. Therefore, according to the third embodiment, it is possible to provide a display control device or the like that preferably displays an image taken by the camera.

The above-mentioned programs can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transient computer-readable media include various types of tangible recording media. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs (Read Only Memory) CD-Rs, CDs. -R / W, including semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

The present invention is not limited to the above embodiment, and can be appropriately modified without departing from the spirit.

10 Display control device 11 Shooting data acquisition unit 12 Operation state detection unit 13 Extracted image data generation unit 14 Display image data generation unit 15 Output unit 16 Index image data generation unit 17 Vehicle information acquisition unit 20 Display control device 30 Display control device 90 Vehicle 91 Camera 91A Left camera 91B Right camera 91C Rear camera 92 Display 93 ECU

Claims (8)

A shooting data acquisition unit that acquires shooting data in which the camera captures the scenery outside the vehicle,
An operating state detection unit that detects the operating state of the vehicle, and
An extracted image data generation unit that generates extracted image data from an image related to the shooting data according to an angle of view set according to the operating state.
A display image data generation unit that generates display image data related to a display image having a preset image size from the extracted image data, and a display image data generation unit.
A display control device including an output unit that outputs the display image data to a display unit having the image size. The operating state detection unit detects the moving speed of the vehicle and
The extracted image data generation unit according to claim 1, wherein the extracted image data generation unit generates extracted image data in which the first angle of view at the first speed is set to be narrower than the second angle of view at the second speed, which is slower than the first speed. Display control device. A vehicle information acquisition unit for acquiring vehicle information regarding the driving state of the vehicle is further provided.
The operating state detection unit detects the operating state based on the vehicle information and determines the operating state.
The display control device according to claim 2, wherein the extracted image data generation unit generates extracted image data set to a first angle of view or a second angle of view depending on the operating state. When the extracted image data generation unit generates the extracted image data set to the second angle of view, the display image data generation unit converts the extracted image into the image size of the display unit. The display control device according to claim 2 or 3, wherein the data is compressed to generate the display image data. The display control device according to any one of claims 1 to 4, further comprising an index image data generation unit that generates and outputs index image data for expressing distortion of the display image. In the display image data generation unit, the distortion of the image related to the first conversion in which the extracted image related to the extracted image data is converted into the display image without being rotated with respect to the display unit causes the extracted image to be displayed in the display unit. The display image is generated by converting the extracted image by the second conversion when the distortion of the image is larger than the distortion of the image subjected to the second conversion which is rotated by 90 degrees with respect to the display image. The display control device according to any one item. The shooting data acquisition step to acquire the shooting data that the camera shot the scenery outside the vehicle,
An operating state detection step for detecting the operating state of the vehicle, and
An extracted image data generation step of generating extracted image data from the shooting data according to the angle of view set according to the operating state, and
A display image data generation step for generating display image data related to a display image having a preset image size from the extracted image data, and a display image data generation step.
A display control method comprising an output step of outputting the display image to a display unit having the image size. The shooting data acquisition step to acquire the shooting data that the camera shot the scenery outside the vehicle,
An operating state detection step for detecting the operating state of the vehicle, and
An extracted image data generation step of generating extracted image data from the shooting data according to the angle of view set according to the operating state, and
A display image data generation step for generating display image data related to a display image having a preset image size from the extracted image data, and a display image data generation step.
A program that causes a computer to execute a display control method including an output step of outputting the display image to a display unit having the image size.

Images