JP2021154887A - Display controller, display control method and program - Google Patents

Abstract

To provide a display controller which satisfactorily displays an image photographed by a camera, and so on.SOLUTION: A display controller 10 comprises: a photographed data acquisition part 11 which acquires photographed data that is generated in such a manner that a camera photographs landscape outside a vehicle; an operation state detection part 12 which detects an operation state of the vehicle; an extraction image data generation part 13 which generates extraction image data from the photographed data by a field angle set according to the operation state; a size allocation part 14 which allocates an image size of a display image corresponding to each extraction image data according to the total image size of a display 92 in response to detecting the operation state; a display image data generation part 15 which generates display image data for each of a plurality of extraction image data according to the allocated image size; and an output part 16 which outputs display image data corresponding to each of the plurality of extraction image data to the display 92.SELECTED DRAWING: Figure 1

Description

The present invention relates to a display control device, a display control method and a program.

A system that captures the scenery outside the vehicle with an in-vehicle camera and displays the captured image on a monitor inside the vehicle has become widespread. In addition, proposals have been made to connect images taken by an in-vehicle camera to support driving.

For example, the system described in Patent Document 1 displays images of the rear and side regions of a vehicle body on two parts of a monitor screen at different compression rates, and changes the compression rates according to vehicle information.

Japanese Unexamined Patent Publication No. 2016-048839

The image displayed by the above system does not mean that the amount of information of the image itself has increased. On the other hand, there is a demand that the amount of information of the image applied to a desired area is increased according to the operating state of the vehicle, and the user of the vehicle wants to easily confirm it. However, the display area cannot be enlarged.

The present invention has been made to solve such a problem, and provides a display control device or the like that preferably displays an image taken by a camera.

The display control device according to the present invention includes a shooting data acquisition unit, an operation state detection unit, an extracted image data generation unit, a size allocation unit, a display image data generation unit, and an output unit. The shooting data acquisition unit acquires shooting data generated by the camera shooting the scenery outside the vehicle. The operating state detection unit detects the operating state of the vehicle. The extracted image data generation unit generates the extracted image data from the captured data according to the angle of view set according to the operating state. The size allocation unit allocates the image size of the display image corresponding to each of the extracted image data according to the total image size of the display unit according to the detection of the operation state. The display image data generation unit generates display image data according to the assigned image size for each of the plurality of extracted image data. The output unit outputs display image data corresponding to each of the plurality of extracted image data to the display unit.

The display control method according to the present invention includes a shooting data acquisition step, an operating state detection step, an extracted image data generation step, a size allocation step, a display image data generation step, and an output step. In the shooting data acquisition step, the shooting data generated by shooting the scenery outside the vehicle is acquired. The operating state detection step detects the operating state of the vehicle. The extracted image data generation step generates the extracted image data from the captured data with the angle of view set according to the operating state. The size allocation step allocates the image size of the display image corresponding to each of the extracted image data according to the total image size of the display unit according to the detection of the operation state. The display image data generation step generates display image data according to the assigned image size for each of the plurality of extracted image data. The output step outputs display image data corresponding to each of the plurality of extracted image data to the display unit.

The program according to the present invention causes a computer to execute a display control method, and the display control method includes a shooting data acquisition step, an operation state detection step, an extracted image data generation step, a size allocation step, and the like. It includes a display image data generation step and an output step. In the shooting data acquisition step, the shooting data generated by shooting the scenery outside the vehicle is acquired. The operating state detection step detects the operating state of the vehicle. The extracted image data generation step generates the extracted image data from the captured data with the angle of view set according to the operating state. The size allocation step allocates the image size of the display image corresponding to each of the extracted image data according to the total image size of the display unit according to the detection of the operation state. The display image data generation step generates display image data according to the assigned image size for each of the plurality of extracted image data. The output step outputs display image data corresponding to each of the plurality of extracted image data to the display unit.

According to the present invention, it is possible to provide a display control device or the like that suitably displays an image taken by a camera.

It is a block diagram of the display system which concerns on Embodiment 1. FIG. FIG. 5 is a top view showing a shooting range of a camera in a vehicle equipped with the display control device according to the first embodiment. It is a flowchart of the display control device which concerns on Embodiment 1. FIG. It is a figure which shows the 1st example of the image taken by the left camera which concerns on Embodiment 1. FIG. It is a figure which shows the 1st example of the display image displayed on the display part which concerns on Embodiment 1. FIG. It is a figure which shows the 2nd example of the image taken by the left camera which concerns on Embodiment 1. FIG. It is a figure which shows the 2nd example of the display image displayed on the display part which concerns on Embodiment 1. FIG. It is a figure which shows the 2nd example of the display image displayed on the display part which concerns on the 1st modification of Embodiment 1. FIG. It is a figure which shows the example of the display image displayed on the display part which concerns on the 2nd modification of Embodiment 1. FIG. It is a top view which shows the photographing range of the camera in the vehicle equipped with the display control device which concerns on Embodiment 2. FIG. It is a flowchart of the display control device which concerns on Embodiment 2. FIG. It is a block diagram of the display system which concerns on Embodiment 3. FIG. It is a figure which shows the example of the display image displayed on the display part which concerns on Embodiment 3. FIG. It is a block diagram of the display system which concerns on Embodiment 4. FIG. It is a flowchart of the display control device which concerns on Embodiment 4. FIG.

Hereinafter, the present invention will be described through embodiments of the invention, but the inventions in the claims are not limited to the following embodiments. Moreover, not all of the configurations described in the embodiments are indispensable as means for solving the problem. For the sake of clarity, the following description and drawings have been omitted and simplified as appropriate. In each drawing, the same elements are designated by the same reference numerals, and duplicate explanations are omitted as necessary.

<Embodiment 1>
The configuration of the display system 1 according to the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram of the display system 1 according to the first embodiment. The display system 1 is a system that notifies a user such as a driver of a vehicle of information related to the scenery outside the vehicle by display. The display system 1 includes a display control device 10, a camera 91, and a display unit 92. The display control device 10, the camera 91, and the display unit 92 are mounted on the vehicle.

The camera 91 is a camera mounted at an arbitrary position of the vehicle, photographs the scenery outside the vehicle, and generates photographing data which is the data of the photographed image. The camera 91 is communicably connected to the display control device 10. The camera 91 generates, for example, 30 frames per second (30 fps) of shooting data, and supplies the generated shooting data to the display control device 10 every 1 / 30th of a second. The shooting data is, for example, H. 264 or H. It may be generated using a method such as 265.

The camera 91 may have a plurality of cameras. The camera 91 in the first embodiment includes a left camera 91A, a right camera 91B, and a rear camera 91C. The left camera 91A, the right camera 91B, and the rear camera 91C are image pickup devices each having an objective lens, an image pickup element, an AD (Analog to Digital) conversion element, and the like. In the first embodiment, the left camera 91A, the right camera 91B, and the rear camera 91C each generate different types of shooting data. That is, the left camera 91A, the right camera 91B, and the rear camera 91C generate shooting data related to the landscapes on the left, right, and rear sides of the vehicle, respectively. Then, the left camera 91A, the right camera 91B, and the rear camera 91C supply the generated shooting data to the display control device 10.

The display unit 92 is a display unit installed so that information can be presented to the user of the vehicle, and includes, for example, a display unit such as a liquid crystal panel or an organic EL (Electro Luminescence) panel. The display unit 92 is installed at a position such as a dashboard where the user can visually recognize the display portion. The display unit 92 is communicably connected to the display control device 10. The display unit 92 receives the image data from the display control device 10 and displays the image related to the received image data on the display portion.

The display control device 10 is a computer or the like that displays information related to the scenery outside the vehicle on the display unit 92. The display control device 10 has, for example, an arithmetic unit such as a CPU (Central Processing Unit) or an MCU (Micro Controller Unit). Further, the display control device 10 has at least a control board composed of a flash memory or a non-volatile or volatile memory such as a DRAM (Dynamic Random Access Memory), and other electric circuits in addition to the above arithmetic unit. ing. The display control device 10 has a program incorporated in these arithmetic units and the like, and realizes the functions shown below by combining software or hardware.

The display control device 10 processes the image data related to the image captured by the camera 91, and outputs the processed predetermined image data to the display unit 92. The display control device 10 includes a shooting data acquisition unit 11, an operation state detection unit 12, an extracted image data generation unit 13, a size allocation unit 14, a display image data generation unit 15, and an output unit 16. These elements of the display control device 10 are communicably connected by a communication bus.

The shooting data acquisition unit 11 acquires shooting data generated by the camera 91 taking a picture of the scenery outside the vehicle. In the first embodiment, the shooting data acquisition unit 11 acquires a plurality of shooting data of different types from the camera 91. The shooting data acquisition unit 11 supplies the acquired shooting data to the extracted image data generation unit 13 via the communication bus.

The operation state detection unit 12 detects the operation state of the vehicle and generates the operation state information according to the operation state. Here, the "operating state of the vehicle" means a state of operation related to the movement of the vehicle. For example, in the first embodiment, the operating state of the vehicle includes a change in the moving direction of the vehicle, and the operating state information includes the moving direction change information indicating the change in the moving direction of the vehicle. The movement direction change information includes the predicted movement direction information indicating the movement direction (predicted movement direction) in which the vehicle is predicted to change. The predicted movement direction may include the movement direction actually changed by the vehicle 90. For example, the operation state detection unit 12 is connected to a positioning information receiving unit (not shown) that receives positioning information for positioning the position of the own vehicle from a satellite positioning system such as GNSS (Global Navigation Satellite System), and receives the positioning information. The operating state of the vehicle may be detected from the change in the position information acquired from the unit. Further, the operating state detecting unit 12 may detect the operating state by estimating the predicted moving direction of the vehicle based on the position information and the map information acquired from the positioning information receiving unit.

The operation state detection unit 12 supplies the operation state information generated as described above to the extracted image data generation unit 13 and the size allocation unit 14.

The extracted image data generation unit 13 receives the shooting data from the shooting data acquisition unit 11. Further, the extracted image data generation unit 13 receives the operation state information from the operation state detection unit 12, and determines the angle of view for generating the extracted image from the received operation state information. More specifically, the extracted image data generation unit 13 according to the first embodiment sets the angle of view according to the change in the moving direction of the vehicle. For example, the extracted image data generation unit 13 first sets the angle of view of the image (extracted image) of the region extracted from the shooting data related to the predicted moving direction in response to the detection of the change in the moving direction of the vehicle. Change the setting from the angle of view to the second angle of view, which is wider than the first angle of view. In the first embodiment, the first angle of view is a preset size of the initial angle of view. At this time, the extracted image data generation unit 13 may continue to set the angle of view of the extracted image extracted from the photographing data related to the direction different from the predicted moving direction to the first angle of view.

The extracted image data generation unit 13 extracts an image having an angle of view determined as described above for each of the captured data from the captured data, and generates the extracted image data related to the extracted image. In this way, the extracted image data generation unit 13 generates the extracted image data from the image related to the photographed data at the angle of view set according to the operating state for each of the photographed data. The extracted image data generation unit 13 supplies the generated extracted image data to the display image data generation unit 15.

The size allocating unit 14 allocates the image size of the display image corresponding to each of the plurality of extracted image data from the total image size of the display unit 92 according to the detection of the operating state. Here, the display image is an image displayed on the display portion of the display unit 92. The "total image size of the display unit 92" is the total image size of the display images that can be displayed on the display portion of the display unit 92. The "total image size of the display unit 92" means the total image size of the area when the display image is displayed in a predetermined area in the display portion instead of the entire display portion of the display unit 92. .. Each display image is assigned a corresponding image size. Each display image may have a rectangular shape. In this case, the image size of each display image may be represented by the product of the number of pixels in the width direction corresponding to the length in the width direction and the number of pixels in the height direction corresponding to the length in the height direction.
The size allocation unit 14 supplies the display image data generation unit 15 with information regarding the image size of the display image corresponding to each of the plurality of extracted image data.

The display image data generation unit 15 receives a plurality of extracted image data from the extracted image data generation unit 13, and receives an image size corresponding to each of the plurality of extracted image data from the size allocation unit 14. The display image data generation unit 15 generates display image data of a display image having an assigned image size for each of the plurality of extracted image data. The display image data is data to be output to the display unit 92, and has a data format such as a bitmap format or a vector format. That is, the display image data generation unit 15 generates display image data related to the display image obtained by converting the pixel values from the extracted image so as to have an image size corresponding to the extracted image. The conversion process performed on the extracted image by the display image data generation unit 15 includes conversion processing such as enlargement / reduction, decompression, compression, noise removal, and color tone correction of the image. The display image data generation unit 15 supplies the generated plurality of display images to the output unit 16.

Specific methods of these processes performed by the display image data generation unit 15 are already known to those skilled in the art. Therefore, although detailed description is omitted here, for example, as a specific embodiment of the method of enlarging or reducing an image, there is stretching or compression of an image. Enlarging or reducing an image changes the distance between a predetermined pixel and surrounding pixels, and interpolates the pixels in between. Further, stretching the image means stretching the image along a predetermined direction. In this case, for the pixels in the stretching direction, the distance between the pixels is widened, and the pixels in between are interpolated. Also, compressing an image means shrinking the image along a predetermined direction. In this case, for the pixels in the shrinking direction, the distance between the pixels is narrowed and the pixels are interpolated as appropriate.

The output unit 16 is an interface for communicably connecting the display control device 10 and the display unit 92. The output unit 16 outputs the display image data corresponding to each of the plurality of extracted image data to the display unit 92.

Next, an example of the shooting range of the camera in the vehicle will be described with reference to FIG. FIG. 2 is a top view showing a shooting range of a camera in a vehicle equipped with the display control device according to the first embodiment. The vehicle 90 shown in FIG. 2 is an automobile, which is an embodiment as a moving body.

The vehicle 90 has three cameras, a left camera 91A, a right camera 91B, and a rear camera 91C described in FIG. The left camera 91A is installed on the left side of the vehicle 90 and photographs the scenery on the left side of the vehicle 90. The left camera 91A has a shooting angle of view A10 in the horizontal direction indicated by the alternate long and short dash line is 180 degrees. That is, the image taken by the left camera 91A includes a landscape with an angle of view of 180 degrees on the left side of the vehicle 90. The right camera 91B is installed on the right side of the vehicle 90 and photographs the scenery on the right side of the vehicle 90. The right camera 91B has a horizontal shooting angle of view B10 of 180 degrees. Similarly, the rear camera 91C is installed on the back surface of the vehicle 90 and photographs the scenery behind the vehicle 90. The rear camera 91C has a horizontal shooting angle of view C10 of 180 degrees. In the following description, the horizontal angle of view or the horizontal angle of view may be simply referred to as "angle of view".

The solid line extending radially from the left camera 91A to the left rear of the vehicle 90 indicates the angle of view A11 of the extracted image extracted from the image captured by the left camera 91A and the angle of view A12 wider than the angle of view A11. For example, the extracted image data generation unit 13 sets the angle of view to the angle of view A11, which is the first angle of view, when the vehicle 90 continues to move straight in the traveling direction, and the change in the moving direction to the left is detected. The setting of the angle of view is changed to the angle of view A12, which is the second angle of view.

The solid line extending radially from the right camera 91B to the right rear of the vehicle 90 indicates the angle of view B11 of the extracted image extracted from the captured image of the right camera 91B and the angle of view B12 wider than the angle of view B11. The angle of view B11 may have the same size as the angle of view A11, and the angle of view B12 may have the same size as the angle of view A12. For example, the extracted image data generation unit 13 sets the angle of view to the angle of view B11, which is the first angle of view, when the vehicle continues to move straight in the traveling direction, and the change in the moving direction to the right is detected. The angle of view is changed to the second angle of view B12 accordingly.

Then, the extracted image data generation unit 13 generates the extracted image data of the extracted image related to the set angle of view from each of the photographed images of the landscapes on the different directions. Here, these extracted image data are the first extracted image data of the extracted image related to the landscape on the first direction (here, left) side with respect to the vehicle 90, and the second direction (here, right here) with respect to the vehicle 90. ) Has a second extracted image data of the extracted image related to the landscape on the side.
As described above, the extracted image data generation unit 13 sets and changes the angle of view of the extracted image related to the landscape on the predicted moving direction side in response to the detection of the change in the moving direction, and the extracted image of the extracted image. Generate data.

As shown in FIG. 2, the solid line extending radially from the rear camera 91C to the rear of the vehicle 90 indicates the angle of view C11 of the extracted image extracted from the captured image of the rear camera 91C.

Next, the process performed by the display control device 10 will be described with reference to FIG. FIG. 3 is a flowchart of the display control device 10 according to the first embodiment. The flowchart shown in FIG. 3 shows a case where the display control device 10 displays display images related to the landscapes on the left and right sides of the vehicle 90 shown in FIG. 2 on the display portion of the display unit 92 (that is, a two-screen display). Case) is shown as an example of processing. The flowchart shown in FIG. 3 is started, for example, by activating the main system of the vehicle 90. It is assumed that the angle of view of the extracted image is set at the first angle of view at the initial stage.

First, in step S10, the shooting data acquisition unit 11 of the display control device 10 acquires shooting data from each of the left camera 91A and the right camera 91B. Here, the shooting data acquired from the left camera 91A is the shooting data related to the scenery on the first direction side of the vehicle 90, and the shooting data acquired from the right camera 91B is related to the scenery on the second direction side of the vehicle 90. It is the shooting data to be performed.
Next, in step S11, the operation state detection unit 12 of the display control device 10 determines whether or not a change in the moving direction of the vehicle 90 has been detected as the operation state of the vehicle 90. When the operation state detection unit 12 determines that the change in the movement direction has been detected (step S11: Yes), the operation state detection unit 12 generates the movement direction change information including the predicted movement direction information. Then, the operation state detection unit 12 supplies the movement direction change information to the extraction image data generation unit 13 and the size allocation unit 14, and proceeds to the process in step S12. On the other hand, when the operation state detection unit 12 does not determine that the change in the moving direction has been detected (step S11: No), the process proceeds to step S14.

In step S12, the extracted image data generation unit 13 first sets the angle of view of the extracted image extracted from the shooting data related to the landscape on the predicted moving direction side based on the predicted moving direction information included in the moving direction change information. Change the setting from the angle of view to the second angle of view. The extracted image data generation unit 13 also continuously sets the angle of view of the extracted image extracted from the photographing data related to the direction different from the predicted moving direction to the first angle of view. Then, the extracted image data generation unit 13 advances the processing to S14.

In step S14, the extracted image data generation unit 13 generates the extracted image data from the photographed data by using the angle of view set for the extracted image according to the type of the photographed data. That is, when a change in the moving direction is detected and the predicted moving direction is the first direction, the extracted image data generation unit 13 extracts the image taken from the left camera 91A over the angle of view A12 wider than the angle of view A11. The first extracted image data of the image is generated. Further, in this case, the extracted image data generation unit 13 generates the second extracted image data of the extracted image related to the angle of view B11 from the captured data from the right camera 91B. On the other hand, when the change in the moving direction is not detected and the predicted moving direction is not acquired, the extracted image data generation unit 13 obtains the first extracted image data of the extracted image related to the angle of view A11 from the captured data from the left camera 91A. Generate. Further, in this case, the extracted image data generation unit 13 generates the second extracted image data of the extracted image related to the angle of view B11 from the captured data from the right camera 91B.

In step S15, the extracted image data generation unit 13 determines whether or not all the extracted image data have been generated. In the first embodiment, the extracted image data generation unit 13 determines whether or not two extracted image data have been generated. When the extracted image data generation unit 13 determines that all the extracted image data has been generated (step S15: Yes), the process proceeds to step S16. On the other hand, the extracted image data generation unit 13 returns the process to step S14 if this is not the case (step S15: No). Then, the extracted image data generation unit 13 supplies all the generated extracted image data to the display image data generation unit 15.

In step S16, the size allocation unit 14 has, for each of the plurality of extracted image data, the display image corresponding to each extracted image according to the predicted moving direction of the predicted moving direction information included in the moving direction change information. Assign an image size. At this time, the size allocation unit 14 sets the number of pixels included in the display image corresponding to the first extracted image data to the display image corresponding to the second extracted image data according to the predicted moving direction being the first direction. The image size is assigned so that it is larger than the number of pixels included. In the first embodiment, the size allocation unit 14 has a length in the primary direction which is the width in the horizontal direction of the first display image corresponding to the first extracted image data according to the predicted movement direction being the first direction. The image size is assigned so that the length of the second display image corresponding to the second extracted image data is larger than the length in the primary direction. Here, the first and second display images are display images corresponding to the extracted images of the first and second extracted image data, respectively. The primary direction is the width direction or the height direction, and in the first embodiment, it is the width direction. Further, in the first embodiment, the length in the primary direction is the length of the width which is one side in the width direction, and corresponds to the number of pixels in the width. The size allocation unit 14 supplies the display image data generation unit 15 with information regarding the image size of the display image corresponding to each of the plurality of extracted image data.

Next, in step S17, the display image data generation unit 15 generates display image data of a display image having a corresponding image size for each of the plurality of extracted image data.
Specifically, the display image data generation unit 15 generates the first display image data of the first display image without performing pixel conversion processing on the extracted image related to the first extracted image data. On the other hand, the display image data generation unit 15 compresses the image for the extracted image related to the second extracted image data and generates the second display image data of the second display image.
Then, the display image data generation unit 15 supplies the generated plurality of display image data to the output unit 16.

Next, in step S18, the output unit 16 of the display control device 10 outputs each of the plurality of display image data received from the display image data generation unit 15 to the display unit 92.

Next, in step S19, the display control device 10 determines whether or not to end a series of processes. The case of terminating a series of processes is, for example, a case where the system is stopped or a case where the process is terminated by the operation of the driver. When the display control device 10 does not determine that the series of processes is completed (step S19: No), the display control device 10 returns the processes to step S10. When the display control device 10 determines that the series of processes is to be completed (step S19: Yes), the display control device 10 ends the processes.

By the above processing, the display control device 10 sets the angle of view of the extracted image according to the change in the moving direction of the vehicle 90. In the above description, the case where the predicted movement direction is the first direction is shown as an example, but of course, the above processing is also applied to the case where the predicted movement direction is the second direction.

Next, an example of an image taken by the left camera 91A will be described with reference to FIG. FIG. 4 is a diagram showing a first example of an image taken by the left camera 91A according to the first embodiment. Here, the first example is an example in which the vehicle 90 continues to travel straight in the traveling direction, that is, a change in the moving direction is not detected. In the image P10 shown in FIG. 4, the left camera 91A captures the landscape on the left side (that is, the first direction side) of the vehicle 90. The right side of the page of the image P10 is the landscape of the left front of the vehicle 90, and the left side of the page of the image P10 is the landscape of the left rear of the vehicle 90. A truck and a motorcycle are photographed on the right side of the page of image P10. That is, a truck and a two-wheeled vehicle exist in front of the left side of the vehicle 90. Further, another vehicle H1, another vehicle H2, and another vehicle H3 are photographed on the left side of the page of the image P10. That is, other vehicles H1 to H3 exist behind the left rear of the vehicle 90. Since the image P10 is an image taken at a wide angle of view of 180 degrees, it has a predetermined distortion. Therefore, the image included in the image P10 is displayed in a distorted state.

On the left side of the paper surface of the image P10 shown in FIG. 4, the outer edge T11 of the extracted image is indicated by a thick alternate long and short dash line. That is, the extracted image is a region surrounded by the outer edge T11. Here, the outer edge T11 shows an extracted image relating to the above-mentioned angle of view A11. Since the change in the moving direction was not detected, the extracted image data generation unit 13 sets the angle of view to the angle of view A11 and extracts the region indicated by the outer edge T11 to extract the first extraction from the captured data shown in FIG. Generate image data. The area surrounded by the outer edge T11 includes another vehicle H1 and another vehicle H2. Therefore, the extracted image includes the other vehicle H1 and the other vehicle H2. The outer edge T11 shown in FIG. 4 is distorted so as to correspond to the distortion aberration of the image P10.

As for the right camera 91B, as in the case of the left camera 91A, when the change in the moving direction is not detected, the extracted image data generation unit 13 generates the second extracted image data of the extracted image related to the angle of view B11.

Then, the size allocation unit 14 allocates the image size of the display image described later for each of the first and second extracted image data. Then, the display image data generation unit 15 converts the extracted image so that the outer edge becomes rectangular and the image size of the assigned display image is obtained.

Next, an example of a display image displayed by the display unit 92 will be described with reference to FIG. FIG. 5 is a diagram showing a first example of a display image displayed on the display unit 92 according to the first embodiment. FIG. 5 shows the display image P100. The display image P100 includes a first display image P11 and a second display image P13.

The first display image P11 is an image generated from the shooting data of the left camera 91A. The second display image P13 is an image generated from the shooting data of the right camera 91B. That is, in the display image P100, the captured data generated by the left camera 91A and the right camera 91B are appropriately extracted by the extraction image data generation unit 13, and further converted by the display image data generation unit 15 as display images and displayed side by side. Has been done.

The first display image P11 shown in FIG. 5 is generated from the first extracted image data extracted by the outer edge T11 shown in FIG. Therefore, the first display image P11 includes another vehicle H1 and another vehicle H2.
The second display image P13 is generated from the second extracted image data, and the second display image P13 includes another vehicle H4.

Here, the display image P100 has a width W. Then, the first display image P11 is displayed in the area of the width W11 in the display image P100. Further, the second display image P13 is displayed in the area of the width W13 in the display image P100. As shown in this figure, the total length of the width W11 and the width W13 is equal to the length of the width W. The width W11 and the width W13 may have equal lengths to each other.
As shown in this figure, the lengths of the width W11 and the width W13 are the first display images P11 and the first display image P11 and the first display image P11 and the second as substantially distortion-free images from the first and second extracted image data of the extracted image having distortion, respectively. 2 It may be predetermined that the display image P13 is generated.

In the first example, the size allocation unit 14 corresponds to the first image size corresponding to the length of the width W11 with respect to the first extracted image data and the length of the width W13 with respect to the second extracted image data. Allocate a second image size. Then, the display image data generation unit 15 generates the first display image P11 and the second display image P13 in a state where there is substantially no distortion based on the image size.

Next, another example of the image captured by the camera will be described with reference to FIG. FIG. 6 is a diagram showing a second example of an image taken by the left camera 91A according to the first embodiment. Here, the second example is an example in which a change in the moving direction is detected and the predicted moving direction is the left direction (that is, the first direction). The image P10 shown in FIG. 6 is a photograph of the landscape on the left side of the vehicle 90 by the left camera 91A, similarly to the image shown in FIG. In the image P10 shown in FIG. 6, the outer edge T12 of the extracted image is different from the outer edge T11 shown in FIG.

On the left side of the paper surface of the image P10 shown in FIG. 6, the outer edge T12 is indicated by a thick alternate long and short dash line. The outer edge T12 shows an extracted image relating to the above-mentioned angle of view A12. When generating the first extracted image data from the captured data shown in FIG. 6, the extracted image data generation unit 13 sets the angle of view to the angle of view A12 because the predicted moving direction is the left direction, and the area indicated by the outer edge T12. Is extracted. The angle of view A12 is wider than the angle of view A11. Therefore, the region surrounded by the outer edge T12 includes the other vehicle H1 and the other vehicle H2 as well as the other vehicle H3. Therefore, the extracted image includes other vehicles H1 to H3.

On the other hand, for the right camera 91B, the extracted image data generation unit 13 generates the second extracted image data of the extracted image pertaining to the angle of view B11, as in the first example.

Then, the size allocation unit 14 allocates the image size of the display image described later for each of the first and second extracted image data. Then, the display image data generation unit 15 converts the extracted image so that the outer edge becomes rectangular and the image size of the assigned display image is obtained.

Next, an example of a display image displayed by the display unit 92 will be described with reference to FIG. 7. FIG. 7 is a diagram showing a second example of a display image displayed on the display unit 92 according to the first embodiment. FIG. 7 shows the display image P101. The display image P101 is different from the image P100 shown in FIG. 5 in that it has the first display image P14 and the second display image P16 in place of the first display image P11 and the second display image P13. The points different from the image P100 will be mainly described below.

The first display image P14 shown in FIG. 7 is generated from the first extracted image data extracted by the outer edge T12 shown in FIG. Therefore, the first display image P14 includes the other vehicle H3 in addition to the other vehicle H1 and the other vehicle H2.

Here, the width W14 of the area where the first display image P14 is displayed is longer than the width W11 of the first display image P11 shown in FIG. That is, in the size allocation unit 14, the first display image P14 is related to the first display image P14 of the first extracted image data of the extracted image which is related to the predicted movement direction and has a wider angle of view than the first example. The length of the width W14 is determined so that the image is substantially distortion-free.

On the other hand, the second display image P16 is generated from the extracted image extracted by the outer edge having the same angle of view B11 as in the first example. The second display image P16 includes another vehicle H4 as in the first example.
Here, the width W16 of the area where the second display image P16 is displayed is shorter than the width W14 of the area where the first display image P14 is displayed. In this figure, the total length of the width W14 and the width W16 is equal to the total length of the width W11 and the width W13 shown in FIG. 5, that is, the length of the width W. That is, the size allocation unit 14 has a width W 14 corresponding to the first display image P14 from the width W with respect to the second display image P16 of the second extracted image data related to the direction different from the predicted movement direction. Is assigned as the length of the width W16.

That is, the size allocation unit 14 determines the image size of the display image related to the predicted moving direction, and sets the image size of the displayed image related to the direction different from the predicted moving direction between the total image size and the determined image size. Allocate based on the difference between.

The width W16 of the area where the second display image P16 is displayed is shorter than the width W13 of the second display image P13 shown in FIG. Therefore, when the second display image P13 and the second display image P16 are compared, the width direction of the second display image P16 is relatively compressed.

As described above, the display control device 10 according to the first embodiment generates a plurality of extracted image data with the angle of view set according to the operating state. This makes it easy to display information in a wide range of places that the user wants to confirm without enlarging the area of the display portion. Further, the display control device 10 allocates an image size to each of the plurality of extracted image data based on the operating state. Therefore, without enlarging the area of the display portion, the information of the more important place is displayed relatively large according to the operating state, and the information of the place that the user wants to confirm can be confirmed more easily. As described above, the display control device 10 according to the first embodiment can preferably support the driving of the user by appropriately displaying the image captured by the camera.

<First Modified Example of Embodiment 1>
In the first embodiment, the display control device 10 sets the angle of view of the extracted image related to the direction different from the predicted moving direction to the first angle of view, and displays the display image of the extracted image related to the first angle of view. It was displayed on 92. However, instead of this, the display control device 10 sets the angle of view of the extracted image related to the direction different from the predicted moving direction to the image of the extracted image related to the predicted moving direction in response to the detection of the change in the moving direction. As with the corner, the setting may be changed to the second angle of view.

That is, in step S12 shown in FIG. 3, the extracted image data generation unit 13 sets the angle of view of the extracted image to the second angle of view regardless of the predicted moving direction.
Then, in step S14 shown in FIG. 3, when the change in the moving direction is detected, the extracted image data generation unit 13 generates the first extracted image data of the extracted image related to the angle of view A12. Further, in this case, the extracted image data generation unit 13 generates the second extracted image data of the extracted image applied to the angle of view B12. On the other hand, when the change in the moving direction is not detected, the extracted image data generation unit 13 generates the first extracted image data of the extracted image related to the angle of view A11. Further, in this case, the extracted image data generation unit 13 generates the second extracted image data of the extracted image related to the angle of view B11.

A display image displayed on the display unit 92 according to such a modification will be described with reference to FIG. FIG. 8 is a diagram showing a second example of a display image displayed on the display unit 92 according to the first modification of the first embodiment.
FIG. 8 shows the display image P102. The display image P102 is different from the image P101 shown in FIG. 7 in that the display image P102 has the second display image P18 instead of the second display image P16. The points different from the image P101 will be mainly described below.

The width W18 of the area where the second display image P18 is displayed is shorter than the width W14 of the area where the first display image P14 is displayed. In this figure, the total length of the width W14 and the width W18 is equal to the total length of the width W14 and the width W16 shown in FIG. 7, that is, the length of the width W. That is, the size allocation unit 14 is the first from the length of the width W with respect to the second display image P18 of the second extracted image data related to the direction different from the predicted movement direction, as in the case of the second display image P16. The length obtained by subtracting the length of the width W14 corresponding to the display image P14 is assigned as the length of the width W18.
The length of the width W18 of the area where the second display image P18 is displayed is equal to the length of the width W16 of the second display image P16 shown in FIG. 7. Here, the second display image P18 is generated from the extracted image extracted by the outer edge of the angle of view B12 wider than the angle of view B11, and the second display image P18 includes the other vehicle H4 included in the second display image P16. In addition, another vehicle H5 is included. Therefore, when the second display image P16 and the second display image P18 are compared, the width direction of the second display image P18 is relatively compressed.

<Second variant of Embodiment 1>
In the first embodiment, the case of two-screen display has been described as an example. However, not limited to this, the display control device 10 displays the display image related to the landscape on the rear side in addition to the display image related to the landscape on the left side and the right side of the vehicle 90 shown in FIG. It may be displayed on the part. That is, the second modification is an example in the case of three-screen display.

In this case, the extracted image data generated by the extracted image data generation unit 13 is, in addition to the first and second extracted image data, a third extraction related to the landscape on the third direction (here, behind) side with respect to the vehicle. It has more image data.

At this time, the steps shown in FIG. 3 are changed as follows.
First, instead of step S10, the shooting data acquisition unit 11 of the display control device 10 acquires shooting data from each of the left camera 91A, the right camera 91B, and the rear camera 91C.

Instead of step S12 shown in FIG. 3, the extracted image data generation unit 13 sets the angle of view of the extracted image related to the landscape on the predicted moving direction side from the first angle of view to the second angle of view based on the predicted moving direction information. Change the setting to. Further, the extracted image data generation unit 13 continues to set the angle of view of the extracted image related to the direction opposite to the predicted moving direction to the first angle of view. Further, the extracted image data generation unit 13 continues to set the angle of view of the extracted image related to the rear side to C11. Then, the extracted image data generation unit 13 advances the processing to S14.

Further, in addition to step S14, the extracted image data generation unit 13 generates the third extracted image data of the extracted image related to the set angle of view C11.

Further, instead of step S15, the extracted image data generation unit 13 determines whether or not three extracted image data have been generated. When the extracted image data generation unit 13 determines that all the extracted image data has been generated, the process proceeds to step S16. On the other hand, the extracted image data generation unit 13 returns the process to step S14 if this is not the case. Then, the extracted image data generation unit 13 supplies the three generated extracted image data to the display image data generation unit 15.

Then, instead of step S16, in the size allocation unit 14, the number of pixels included in the display image corresponding to the first extracted image data is the number of pixels included in the second extracted image data and the second extracted image data, depending on the predicted movement direction being the first direction. The image size is assigned so as to be larger than the number of pixels included in the display image corresponding to any of the third extracted image data.

Next, the display image displayed on the display unit 92 in the case of the three-screen display will be described with reference to FIG. FIG. 9 is a diagram showing an example of a display image displayed on the display unit 92 according to the second modification of the first embodiment. 9 (a) corresponds to the first example in which the change in the moving direction was not detected, and FIGS. 9 (b) and 9 (c) correspond to the second example in which the change in the moving direction was detected. .. The parts corresponding to FIGS. 5 and 7 are designated by the same reference numerals and the description thereof will be omitted.

Display images P103 to 105 are shown in FIGS. 9A to 9C. The lengths of the displayed images P103 to 105 in the width direction are all W'.

As shown in FIG. 9A, the display image P103 includes a third display image P12 in addition to the first display image P11 and the second display image P13.
The third display image P12 is displayed in the area of the display image P103 whose length in the width direction is W12. As shown in this figure, the total size of W11, W12 and W13 is W'. W11, W12 and W13 may have the same size as each other.

In the first example, the size allocation unit 14 sets the length of the width W11 with respect to the first extracted image data, the length of the width W13 with respect to the second extracted image data, and the length of the width W13 with respect to the third extracted image data. Allocate the length of width W12. Then, the display image data generation unit 15 generates the first display image P11, the second display image P13, and the third display image P12 in a state where there is substantially no distortion based on the image size corresponding to the length.

As shown in FIG. 9B, the display image P104 includes a third display image P12 having a width W12 similar to that in FIG. 9A in addition to the first display image P14 and the second display image P16. include.

The size allocation unit 14 has a width W16 so that the width direction of the second display image P16, which is related to the direction opposite to the predicted movement direction, is relatively compressed as compared with the first example. Assign a length (length of width W16 <length of width W13). On the other hand, the size allocating unit 14 allocates the length of the width W12 for the other third display image P12 related to the rear side as in the first example. In this way, the size allocation unit 14 may allocate the corresponding length in the width direction according to the type of the extracted image data.

As a result, the user of the vehicle 90 can confirm the situation on the rear side of the vehicle 90 while obtaining the same effect as that of the first embodiment.

In the second example, the size allocation unit 14 has a width direction different from the length in the width direction in the first example with respect to the third display image according to the moving speed of the other vehicle H6 behind the vehicle 90. You may assign a length. For example, in the second example, when the moving speed of the other vehicle H6 behind the vehicle 90 is less than a predetermined threshold value, the size allocation unit 14 has a length in the width direction of the third display image more than that of the first example. The length in the width direction may be assigned so as to be smaller.

As shown in FIG. 9C, the display image P105 has a second display image P19 having a width W19 and a width W18 instead of the second display image P13 and the third display image P12 in FIG. 9A. The third display image P18 is included. The width W18 of the third display image P18 is shorter than the width W12 of the third display image P12. As a result, the width W19 of the second display image P19 becomes longer than the width W16 of the second display image P16 shown in FIG. 9B.

As a result, the compressibility of the second display image P19 in the width direction with respect to the second display image P13 is smaller than that of the second display image P16. That is, the distortion of the image of the second display image P19 is reduced as compared with that of the second display image P16. Therefore, the user of the vehicle can easily confirm the situation on the opposite side of the predicted movement direction of the vehicle while obtaining the same effect as that of the first embodiment.

<Embodiment 2>
Next, a second embodiment of the present invention will be described with reference to FIGS. 10 to 11. In the second embodiment, the size of the angle of view of the extracted image is set based on the moving speed of the vehicle 90 in addition to the predicted moving direction, and the image size of the displayed image is assigned based on the size of the angle of view. It has characteristics. The display control device 20 of the second embodiment has basically the same configuration and function as the display control device 10 of the first embodiment. Hereinafter, the differences from the first embodiment will be mainly described.

In the second embodiment, the operating state of the vehicle includes the moving speed of the vehicle in addition to the change of the moving direction of the vehicle. The operating state detection unit 12 may analyze, for example, an image related to the photographing data acquired by the photographing data acquisition unit 11 and detect the operating state of the vehicle from the change in the position of the object included in the analyzed image.

The operating state detection unit 12 may be connected to, for example, an acceleration sensor (not shown) and detect the operating state of the vehicle from the change in acceleration acquired from the acceleration sensor. Further, the operation state detection unit 12 may detect the operation state of the vehicle from the change of the position information acquired from the positioning information receiving unit.

The extracted image data generation unit 13 according to the second embodiment sets the angle of view according to the moving speed of the vehicle in addition to changing the moving direction of the vehicle. Then, the extracted image data generation unit 13 generates the extracted image data of the extracted image applied to the angle of view set based on the predicted moving direction and the moving speed.

Further, the size allocating unit 14 according to the second embodiment allocates the image size of the display image corresponding to each of the plurality of extracted image data generated as described above.

Here, the angle of view of the second embodiment will be described with reference to FIG. FIG. 10 is a top view showing a shooting range of the camera 91 in the vehicle 90 equipped with the display control device 20 according to the second embodiment. The top view of the vehicle 90 shown in FIG. 10 is different from FIG. 2 in that the left camera 91A has an angle of view A13 and the right camera 91B has an angle of view B13.

In FIG. 10, the solid line extending radially from the left camera 91A to the left rear of the vehicle 90 is from the angle of view A11 of the extracted image extracted from the image captured by the left camera 91A, the angle of view A12 wider than the angle of view A11, and the angle of view A12. It shows a wide angle of view A13.

In FIG. 10, the solid line extending radially from the right camera 91B to the right rear of the vehicle 90 is from the angle of view B11 of the extracted image extracted from the image captured by the right camera 91B, the angle of view B12 wider than the angle of view B11, and the angle of view B12. It shows a wide angle of view B13.

For example, the extracted image data generation unit 13 sets the angle of view of the extracted image to the angle of view A11 when the vehicle 90 continues to travel straight in the traveling direction. For example, the extracted image data generation unit 13 determines the angle of view of the extracted image when the change in the moving direction of the vehicle 90 is detected, the predicted moving direction is the first direction, and the moving speed is the first speed. Set to angle A12. The extracted image data generation unit 13 detects a change in the moving direction of the vehicle 90, and when the predicted moving direction is the first direction and the moving speed is the second speed slower than the first speed, the image applied to the extracted image. The angle is set to the angle of view A13.

When the predicted movement direction is the second direction, the angle of view A11 is read as the angle of view B11, the angle of view A12 is read as the angle of view B12, and the angle of view A13 is read as the angle of view B13.

Next, with reference to FIG. 11, the process executed by the display control device 20 according to the second embodiment will be described. FIG. 11 is a flowchart of the display control device 20 according to the second embodiment. The step shown in FIG. 11 has steps S20 to 26 instead of steps S12 and S16 shown in FIG. The same steps as those shown in FIG. 3 are designated by the same symbols and the description thereof will be omitted as appropriate.

In step S20, the operating state detection unit 12 detects the change in the moving direction of the vehicle 90 and acquires the moving speed information regarding the moving speed of the vehicle in response to the acquisition of the predicted moving direction information (step S11: Yes). do. The operation state detection unit 12 supplies the predicted moving direction information and the moving speed information to the extracted image data generation unit 13.

Then, in step S22, the extracted image data generation unit 13 sets the size of each angle of view of the plurality of extracted images of different types based on the predicted moving direction information and the moving speed information.

Next, in step S24, the extracted image data generation unit 13 generates the extracted image data corresponding to each of the plurality of extracted images by using the angle of view set for each of the plurality of extracted images. At this time, when the predicted moving direction is the first direction and the moving speed is equal to or higher than a predetermined threshold value, the extracted image data generation unit 13 sets the first extracted image data of the extracted image on the angle of view A12 and the angle of view B11. The second extracted image data of the extracted image is generated. When the predicted moving direction is the first direction and the moving speed is less than a predetermined threshold value, the extracted image data generation unit 13 covers the first extracted image data of the extracted image at the angle of view A13 and the angle of view B11. The second extracted image data of the extracted image is generated. On the other hand, when the change in the moving direction is not detected and the predicted moving direction is not acquired, the extracted image data generation unit 13 determines the first extracted image data of the extracted image related to the angle of view A11 and the extracted image related to the angle of view B11. The second extracted image data is generated. Then, the extracted image data generation unit 13 supplies the generated plurality of extracted image data to the display image data generation unit 15.

Next, in step S26, the size allocating unit 14 allocates the image size of the display image to each of the plurality of extracted image data according to the size of the set angle of view. At this time, the size allocation unit 14 allocates the first image size of the first display image based on the size of the angle of view corresponding to the first extracted image data related to the predicted movement direction, and assigns the total image size and the first image. A second image size of the second display image may be assigned based on the difference from the size. That is, the size allocation unit 14 may determine the image size of the display image corresponding to the second extracted image data based on the size of the angle of view corresponding to the first extracted image data. The size allocation unit 14 supplies information on the image size of the display image corresponding to each of the plurality of extracted image data to the display image data generation unit 15, and proceeds to the process in step S17.

As described above, the display control device 20 according to the second embodiment allocates an image size to each of the plurality of extracted image data based on the size of the angle of view set based on the predicted moving direction and the moving speed. A display image of the image size is displayed. Therefore, when the vehicle 90 approaches the change point of the movement direction and slows down the movement speed, it is easier to confirm a wider range of information of the place where the user of the vehicle 90 wants to confirm without expanding the area of the display portion. can do. Therefore, the display control device 20 according to the second embodiment can more preferably support the driving of the user by appropriately displaying the image taken by the camera.

<Embodiment 3>
Next, the third embodiment will be described. The third embodiment is characterized in that the display control device displays the index image data on the display unit 92. FIG. 12 is a block diagram of the display system 3 according to the third embodiment. The third embodiment is different from the second embodiment in that the display system 3 includes the display control device 30 instead of the display control device 20. The display control device 30 has an index image data generation unit 17 in addition to the configuration of the display control device 20.

The index image data generation unit 17 acquires the distortion state of the display image generated by the display image data generation unit 15, and generates an index image according to the acquired distortion state. The "index image data" is data of the "index image" indicating a distorted state of the display image included in the display image data. The index image is configured so that it can be compared with, for example, an image when the display image data generation unit 15 generates an image without distortion.
The index image data generation unit 17 supplies the generated index image data to the output unit 16, and the output unit 16 outputs the index image data together with each display image to the display unit 92.

A specific example of the index image will be described with reference to FIG. FIG. 13 is a diagram showing an example of a display image displayed on the display unit 92 according to the third embodiment. The image P106 shown in FIG. 13 is obtained by superimposing an index image on the image P101 shown in FIG. 7. The index image G14 is superimposed on the upper part of the first display image P14. The index image G16 is superimposed on the upper part of the second display image P16. By arranging the index images G14 and G16 at the upper part of each image, the display control device 30 suppresses the index image from interfering with the display of other vehicles, roads, and the like.

The index image G14 has a circular shape. This means that the first display image P14 related to the index image G14 has no distortion. On the other hand, the index image G16 has a vertically long ellipse having a relatively long height direction and a relatively short width direction. The length of this great circle in the height direction is the same as that of the index image G14. That is, the index image G16 has a shape in which the width direction is relatively compressed as compared with the index image G14. This indicates that the second display image P16 related to the index image G16 is relatively compressed in the width direction. With such a display, the user can intuitively understand how the display image related to the index image is distorted when the index image is visually recognized.

Although the third embodiment has been described above, the index image has the same tendency as the distortion of the displayed image by multiplying the actual distortion by a preset coefficient, but the degree of distortion is different. It may be. As a result, the display control device 30 can generate index image data so that the user can more intuitively understand the distortion state. Further, in the above example, the index image is superimposed on the display image, but the index image may not be superimposed on the display image. For example, when the display image is smaller than the image size of the display unit 92 and there is another display area, the index image may be displayed in the other display area. Further, in the third embodiment, the two-screen display has been described as an example, but the display control device 30 may similarly superimpose the index image on the display image in the three-screen display.

The third embodiment has been described above. The display control device 30 according to the third embodiment compresses and displays the width direction of the image, and also displays an index image indicating that the displayed image is in a compressed and distorted state. Therefore, according to the third embodiment, it is possible to provide a display control device or the like that preferably displays an image taken by the camera.

<Embodiment 4>
Next, the fourth embodiment will be described. The fourth embodiment is characterized in that the display control device detects the operating state of the vehicle based on the vehicle information. FIG. 14 is a block diagram of the display system 4 according to the fourth embodiment. The display system 4 differs from the display system 3 in that the display control device 40 is provided in place of the display control device 30.
The display control device 40 has a vehicle information acquisition unit 18 in addition to the configuration of the display control device 30. Further, the display control device 40 is connected to the ECU 93 (ECU = Electronic Control Unit) of the vehicle 90 via an in-vehicle communication bus such as CAN (Controller Area Network).

The vehicle information acquisition unit 18 is communicably connected to the ECU 93 of the vehicle 90 via the CAN, which is an in-vehicle communication bus, and acquires vehicle information from the ECU 93. The vehicle information is vehicle information related to the driving state of the vehicle, such as the accelerator opening degree, the steering angle of the steering wheel, the operating state of the direction indicator, the position of the shift lever, and the like. Further, the vehicle information may be a combination of the operating state and the moving speed of the vehicle 90. The vehicle information acquisition unit 18 supplies the acquired vehicle information to the operation state detection unit 12.

The operation state detection unit 12 receives vehicle information from the vehicle information acquisition unit 18, and detects the operation state based on the received vehicle information. For example, when the direction indicator indicating the left from the vehicle information acquisition unit 18 (hereinafter referred to as the left direction indicator) is in the ON state, the operation state detection unit 12 detects a change in the moving direction of the vehicle 90 to the left side. do. Further, for example, when the left turn signal is on and the moving speed of the vehicle is a cruising speed such as 50 km / h, the operation state detection unit 12 determines that the vehicle 90 changes lanes to the left. To detect. Further, for example, when the left turn signal is on and the moving speed of the vehicle is about 10 km / h, the operation state detection unit 12 indicates that the vehicle 90 is likely to turn left to the left. To detect. The operation state detection unit 12 detects the operation state of the vehicle 90 as described above, and generates the operation state information from the detected operation state. Then, the operation state detection unit 12 supplies the generated operation state information to the extracted image data generation unit 13.

Next, with reference to FIG. 15, the process executed by the display control device 40 according to the fourth embodiment will be described. FIG. 15 is a flowchart of the display control device 40 according to the fourth embodiment. The step shown in FIG. 15 has a step S40 and a step S42 instead of the step S11 shown in FIG. The same steps as those shown in FIG. 11 are designated by the same symbols and the description thereof will be omitted as appropriate.

In step S40, the operation state detection unit 12 of the display control device 10 determines whether or not the direction indicator of the vehicle 90 is on as the operation state of the vehicle 90. When the operation state detection unit 12 determines that the direction indicator of the vehicle 90 is on (step S40: Yes), the operation state detection unit 12 generates the predicted movement direction information. Then, the operation state detection unit 12 supplies the predicted movement direction information to the extraction image data generation unit 13 and the size allocation unit 14, and proceeds to the process in step S20. On the other hand, when the operation state detection unit 12 does not determine that the direction indicator of the vehicle 90 is on (step S40: No), the process proceeds to step S24.

In step S42, the index image data generation unit 17 generates index image data for each of the plurality of display images. Then, the index image data generation unit 17 supplies the index image data to the output unit 16. In step S18, the output unit 16 outputs each of the plurality of display image data and the corresponding index image data to the display unit 92.

The display control device 40 according to the fourth embodiment does not have to have the index image data generation unit 17. In addition to the vehicle information acquired from the ECU 93, the operation state detection unit 12 may use the change in acceleration acquired from the acceleration sensor and the change in the position information of the own vehicle acquired from the satellite positioning system.

The fourth embodiment has been described above. The display control device 40 according to the fourth embodiment can set the angle of view of the extracted image according to the driving state of the vehicle 90. Then, the display control device 40 according to the fourth embodiment compresses and displays the width direction of the image, and displays an index image indicating that the displayed image is in a compressed and distorted state. Therefore, according to the fourth embodiment, it is possible to provide a display control device or the like that preferably displays an image taken by the camera.

The above-mentioned programs can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transient computer-readable media include various types of tangible recording media. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs (Read Only Memory) CD-Rs, CDs. -R / W, including semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

The present invention is not limited to the above embodiment, and can be appropriately modified without departing from the spirit.

1,3,4 Display system 10, 20, 30, 40 Display control device 11 Shooting data acquisition unit 12 Operating state detection unit 13 Extracted image data generation unit 14 Size allocation unit 15 Display image data generation unit 16 Output unit 17 Index image data Generation unit 18 Vehicle information acquisition unit 90 Vehicle 91 Camera 91A Left camera 91B Right camera 91C Rear camera 92 Display unit 93 ECU

Claims (7)

A shooting data acquisition unit that acquires shooting data generated by the camera shooting the scenery outside the vehicle,
An operating state detection unit that detects the operating state of the vehicle, and
An extracted image data generation unit that generates extracted image data from the shooting data according to the angle of view set according to the operating state, and
A size allocation unit that allocates an image size of a display image corresponding to each of the extracted image data according to the total image size of the display unit according to the detection of the operation state, and a size allocation unit.
A display image data generation unit that generates display image data according to the assigned image size for each of the plurality of extracted image data, and a display image data generation unit.
A display control device including an output unit that outputs the display image data corresponding to each of the plurality of extracted image data to the display unit. The plurality of extracted image data includes a first extracted image data and a second extracted image data.
The display control device according to claim 1, wherein the size allocation unit determines the image size of the display image corresponding to the second extracted image data based on the size of the angle of view corresponding to the first extracted image data. .. A vehicle information acquisition unit for acquiring vehicle information regarding the driving state of the vehicle is further provided.
The display control device according to claim 1 or 2, wherein the operating state detecting unit detects the operating state based on the vehicle information. The plurality of extracted image data includes a first extracted image data related to the landscape on the first direction side with respect to the vehicle and a second extracted image data related to the landscape on the second direction side with respect to the vehicle. Have and
The operating state includes a change in the moving direction of the vehicle.
In the size allocation unit, the length of the display image corresponding to the first extracted image data in the primary direction is the length of the second extracted image data according to the movement direction to be changed being the first direction. The display control device according to any one of claims 1 to 3, wherein an image size is assigned so as to be larger than the length of the display image corresponding to the above in the primary direction. An index image data generation unit for generating index image data for expressing the distortion of the display image is further provided.
The display control device according to any one of claims 1 to 4, wherein the output unit outputs the index image data to the display unit. The shooting data acquisition step to acquire the shooting data generated by the camera shooting the scenery outside the vehicle,
An operating state detection step for detecting the operating state of the vehicle, and
An extracted image data generation step of generating extracted image data from the shooting data with an angle of view set according to the operating state, and
A size allocation step of allocating the image size of the display image corresponding to each of the extracted image data according to the total image size of the display unit according to the detection of the operation state, and
A display image data generation step for generating display image data according to the assigned image size for each of the plurality of extracted image data, and a display image data generation step.
A display control method comprising an output step of outputting the display image data corresponding to each of the plurality of extracted image data to the display unit. The shooting data acquisition step to acquire the shooting data generated by the camera shooting the scenery outside the vehicle,
An operating state detection step for detecting the operating state of the vehicle, and
An extracted image data generation step of generating extracted image data from the shooting data with an angle of view set according to the operating state, and
A size allocation step of allocating the image size of the display image corresponding to each of the extracted image data according to the total image size of the display unit according to the detection of the operation state, and
A display image data generation step for generating display image data according to the assigned image size for each of the plurality of extracted image data, and a display image data generation step.
A program that causes a computer to execute a display control method including an output step of outputting the display image data corresponding to each of the plurality of extracted image data to the display unit.

Images