JPH1178692A - Image display device for vehicle - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device for vehicle which can produce synthetically and display images properly from scene to scene which the vehicle encounters. SOLUTION: Cameras 3-1 thru 3-8 are installed in/on a vehicle to photograph a plurality of images simultaneously, and they are quantized in A/D conversion parts 5-1 through 5-8 and stored in image memories 7-1 thru 7-8 to serve for preparing a plurality of images, and one of a plurality of vehicle operating conditions is selected by a vehicle condition instructing part 11 and instructed. On the basis of the instructed operating condition, the acquired images are deformed and synthesized so that a new image is produced by an image deforming/synthesizing part 13, and the produced image is displayed on a monitor 17.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a vehicle image presenting apparatus, and more particularly to a vehicle image presenting apparatus applicable to a vehicle surrounding monitor system for displaying information of a blind spot from a driver.

[0002]

2. Description of the Related Art Conventionally, as a vehicle surrounding monitoring system, for example, a system described in Japanese Patent Application Laid-Open No. 8-85386 is known. This device is configured to capture images in two directions using a camera directed to a blind spot area from a driver, synthesize the video signals, and present the synthesized signals to the driver.

[0003]

However, in the conventional vehicle surrounding monitor system, only one method of synthesizing and displaying an image is prepared.
Although it is effective in an intended scene for a blind spot from a driver, it is not effective in all conceivable situations.

[0004] Scenes to which the conventional vehicle surrounding monitor system can be applied include garage parking, parking, parallel parking, and approaching an intersection with poor visibility. For example, at an intersection with poor visibility, information on the left and right just before the vehicle is needed, and at this time, the information behind the vehicle is less necessary. On the other hand, when entering the garage or when parking, information about the vicinity of the vehicle is required, and at this time, there is no need for information that is more than 5 m away from the vehicle. As described above, since the camera observation direction required in each scene is different, a different display mode is required.

[0005] The present invention has been made in view of the above,
For that purpose, we synthesize accurate images for each scene encountered.
An object of the present invention is to provide a vehicular image presentation device capable of displaying.

[0006]

According to the first aspect of the present invention,
In order to solve the above-mentioned problems, an image acquisition unit installed in a vehicle and acquiring a plurality of images at the same time, a vehicle state instruction unit for selecting and instructing one of driving states of the plurality of vehicles,
Based on the instructed driving state, a plurality of acquired images are transformed and synthesized to generate a new image.
The gist of the present invention is to include a synthesizing unit and an image display unit for displaying the generated image.

According to a second aspect of the present invention, there is provided an image acquisition means installed in a vehicle for simultaneously acquiring a plurality of images, and a plurality of images acquired in accordance with a driving state of the plurality of vehicles. And a plurality of video display means for displaying the generated video.

According to a third aspect of the present invention, in order to solve the above-mentioned problem, the image transformation / combining means retreats the vehicle and parks and stops at a fixed position, and forwardly moves the vehicle and parks and stops at a fixed position. The gist is to generate a new image corresponding to all scenes or some scenes of a scene, a parallel parking scene, and an approach scene to an intersection with poor visibility.

According to a fourth aspect of the present invention, in order to solve the above-mentioned problem, the image deforming / synthesizing means generates a new image by deforming and synthesizing a plurality of acquired images so as to be mutually continuous. The point is to do.

[0010]

According to the first aspect of the present invention, while being installed in a vehicle and simultaneously acquiring a plurality of images, one of the driving states of the plurality of vehicles is selected and instructed. Here, based on the instructed driving state, a plurality of acquired images are deformed / combined to generate a new image, and by displaying the generated image, the user encounters according to the driving state. An accurate video can be synthesized and displayed for each scene.

According to the second aspect of the present invention, a plurality of images are installed on a vehicle and simultaneously obtained, and the obtained plurality of images are transformed according to the driving states of the plurality of vehicles. Compositing generates a new video and displays the generated video in correspondence with a plurality of monitors, so that accurate video can be simultaneously synthesized and displayed for each scene encountered.

According to the third aspect of the present invention, a scene in which the vehicle moves backward and parks and stops at a fixed position, a case where the vehicle advances and parks and stops in a fixed position, a case where parallel parking is performed, By generating a new image corresponding to all scenes or a part of the scene where a vehicle enters a bad intersection, an accurate image can be synthesized and displayed for each scene encountered.

According to the present invention, a new video is generated by transforming and synthesizing a plurality of obtained videos so as to be continuous with each other. It is possible to combine and display an accurate video having characteristics.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. (First Embodiment) FIG. 1 is a diagram showing a configuration of a vehicular image presentation apparatus according to a first embodiment of the present invention. As shown in FIG. 1, a vehicular image presentation device is provided around a vehicle 1 and includes a plurality of cameras 3 that synchronously capture images in each direction.
-1 to 3-8, a plurality of A / D converters 5-1 to 5-8 for A / D converting video signals from the camera, and digitized image data after A / D conversion are stored. And a timing generator 9 for synchronizing input timings with respect to a plurality of cameras.
Whether the vehicle is in the reverse garage or in the forward garage,
A vehicle state instructing unit 11 for selecting and instructing a driving state of the vehicle such as a parallel parking state or a state of entering an intersection with poor visibility, and an image for deforming and combining a plurality of images according to the instructed vehicle state It comprises a deformation synthesizing unit 13, a monitor 17 for displaying the synthesized video, and a display end switch 15 for instructing the end of display.

Next, the operation of the vehicle image presentation device will be described with reference to FIGS. First, when the driver encounters a scene requiring the surrounding monitor, as shown in FIG. 2, the driver operates the switch panel of the vehicle state instruction unit 11 to input the current state of the own vehicle. Note that the vehicle state instruction unit 1
1 is a reverse garage entering state SW1 as a driving state of the vehicle.
1-1, forward garage entering state SW12-2, parallel parking state SW11-3, intersection approaching state SW1 with poor visibility
1-4 on the switch panel.

First, the operation of the vehicular image presenting apparatus when the reverse garage entering state switch SW11-1 is operated and selected will be described. When the driver encounters the reverse garage entry scene, the driver enters the reverse garage entry state SW11-
When 1 is pressed, the image transformation / synthesis unit 13 is set to the backward garage state.

As shown in FIG. 3, the image transformation / synthesis unit 13 responds to four types of switches of the vehicle state instruction unit 11 by
Four blocks 13-A to 13-D are provided.
The block selected by the vehicle state instructing unit 11 designates a horizontal / vertical address for an image memory in which video captured from each camera is stored.

More specifically, a vertical address LUT 13-2 (lookup table), a horizontal address LUT 13-3, and a memory selector are provided for the coordinate value (x, y) of the composite image indicated by the address counter 13-1. LUT1 for
Data at predetermined addresses in the image memories 7-1 to 7-8 specified by 3-4 are read out, combined into one image, and converted into an image signal via the D / A conversion unit 13-6. Displayed on the monitor 17. More specifically, the horizontal address LUT 13-3, the vertical address LUT 13-2, and the memory selector LUT 13-4 are each composed of a horizontal M × vertical N two-dimensional memory having the same size as the synthesized display image. For example, (x,
Assuming that the value A is stored in (y), the value B is stored in (x, y) of the vertical address LUT, and the value C is stored in (x, y) of the memory selector LUT, the memory selector 13-5 stores the image memory C Is selected, and the value stored at the coordinates (A, B) of the image memory C is output as the coordinates (x, y) of the composite image.

For example, when the vehicle is in a reverse garage, information on the side of the vehicle and information on the rear end of the vehicle are generally important. For this reason, it is desirable that the combined image be configured as shown in FIG. Therefore, the horizontal address LU
T, LUT for vertical address, LUT for memory selector
Need to be set so that a composite image as shown in FIG. 4 can be obtained. It should be noted that the position of the composite image to be arranged in association with the pixel of the position in the image memory,
Since it depends on the layout of the camera attached to the vehicle and the observation angle of view, it must be determined for each vehicle.

By deforming and synthesizing an image using a look-up table in this way, for example, correction of distortion that occurs when photographing is performed using a wide-angle lens, enlargement and highlighting of a region that the driver wants to pay attention to, etc. Can also be done.

The memory selector LUT 13-4
If a non-existent memory number is written in this area and this memory number is accessed, for example, "0" is output as a constant value, as shown in FIG. Can be obtained by adding
The positional relationship between the host vehicle and the surroundings can be made clearer.

As a result, the driver, as shown in FIG.
The vehicle can be guided with reference to the image displayed on the monitor 17. When this guidance is completed, the display end switch 15 is pressed to erase the display on the monitor 17.

Here, the basic operation of the video transformation / synthesis unit 13 will be described. As shown in FIG. 2, the image transformation / synthesis unit 13 is provided with four blocks 13 -A to 13 -D corresponding to the four types of switches of the vehicle state instruction unit 11. The block selected by the vehicle state instructing unit 11 specifies the horizontal and vertical addresses of an image memory in which the video captured from each camera is stored.

Specifically, for the coordinate value (x, y) of the composite image indicated by the address counter 13-1, the horizontal address LUT 13-3 and the vertical address LUT 13-
2. Data at predetermined addresses in the image memories 7-1 to 7-8 specified by the memory selector LUT 13-4 are combined into one image and displayed on the monitor 17. Specifically, the horizontal address LUT (H (x,
y)) 13-3, LUT for vertical address (V (x,
y)) 13-2, LUT for memory selector (S (x,
y)) 13-4 are each composed of a horizontal M × vertical N two-dimensional memory. This is the same size as the composite display image. If the value A is stored in (x, y) of the horizontal address LUT, the value B is stored in the vertical address LUT (x, y), and the value C is stored in (x, y) of the memory selector LUT, The selector 13-5 selects the image memory C, and the value stored at the coordinates (A, B) of the image memory C is output as the coordinates (x, y) of the composite image.

Next, the operation of the vehicular image presenting apparatus when entering the reverse garage will be described with reference to the flowchart shown in FIG. In addition, when entering the forward garage other than when entering the reverse garage,
Even when the vehicle is parked in parallel or when entering an intersection with poor visibility, the flow chart can be basically applied. In this case, only the switch and the LUT block used are different, and the description thereof is omitted.

First, in step S10, it is assumed that the driver has pressed the switch 11-1 of the vehicle state instructing section 11 when encountering a reverse parking garage. Correspondingly,
Block 13-A for reversing the garage of the video deformation synthesizing unit 13
Is selected. Next, in step S20, the vertical address of the composite image is set to y = 1 by the address counter 13-1.

Next, in step S30, the horizontal address of the composite image is set to x = 1 by the address counter 13-1. Next, in step S40, reference is made to the value H1 (x, y) of the horizontal address LUT 13-3 that matches the horizontal and vertical addresses of the set composite image, and α is set to H1 (x, y). Here, the selected horizontal address LU
Since T belongs to the block 13-A of the video transformation / synthesis unit 13, it is described as H1 (x, y). Similarly, LUTs for horizontal addresses belonging to blocks 13-B, 13-C, and 13-D are H2 (x, y), H3 (x, y),
H4 (x, y).

Next, in step S50, the value V1 (x, y) of the vertical address LUT 13-2 that matches the horizontal and vertical addresses of the set composite image is referred to, and β = V1 (x, y). set. Here, the selected vertical address LU
Since T belongs to the 13-A block of the video transformation / synthesis unit 13, it is denoted as V1 (x, y). Similarly, the vertical address LUTs belonging to the blocks 13-B, 13-C, and 13-D are V2 (x, y), V3 (x, y),
V4 (x, y).

Next, in step S60, the value S1 (x, y) of the memory selector LUT 13-4 that matches the horizontal and vertical addresses of the set composite image is referred to, and γ = S1 (x, y). set. Here, the LU for the memory selector to be used
Since T belongs to the block 13-A of the video transformation / synthesis unit 13, it is described as S1 (x, y). Similarly, the memory selector LUTs belonging to the blocks 13-B, 13-C, and 13-D are S2 (x, y) and S3 (x,
y), S4 (x, y).

In step S70, the above-mentioned step S40
Based on the values of α, β, and γ set in steps S60 to S60, the memory selector 13-5 refers to the image memory and determines a value to be output at (x, y) of the composite image. This corresponds to each image memory M1 prepared for storing each camera image.
This is performed by selecting Mγ (α, β) for (x, y), M2 (x, y),..., M8 (x, y). Specifically, the values stored in the horizontal address α and the vertical address β of the γ-th image memory are selected. Thus, the selected value is set in the composite image O (x, y) as O (x, y) = Mγ (α, β).

Next, in step S80, it is determined whether or not the horizontal address of the composite image has reached M. If the horizontal address of the composite image has reached M, the process proceeds to step S100. On the other hand, if the horizontal address of the composite image has not reached M, the process proceeds to step S90. In step S90, if the horizontal address of the composite image has not reached M, the horizontal address is incremented, and the process returns to step S90.
Return to 40.

In step S100, when the horizontal address of the composite image has reached M, it is determined whether or not the vertical address has reached N. If the vertical address has reached N, the process proceeds to step S120. On the other hand, if the vertical address has not reached N, the process proceeds to step S110. In step S110, if the vertical address of the composite image has not reached N, the vertical address is incremented, and the process returns to step S30 again.

On the other hand, when the vertical address of the composite image has reached N in step S100, the composite image O (x, y) is completed as shown in FIG.
It is displayed on the monitor 17 through 3-6. The driver guides the vehicle while referring to the image on the monitor 17, and presses the display end switch 15 after the guide is completed.

Here, in step S120, it is determined whether or not the display end switch 15 has been pressed. Switch 1
When 5 is pressed, the image on the monitor 17 is deleted. If the switch 15 is not pressed, the process returns to step S20 to update the video. In addition, when entering the reverse garage, generally, the side information of the vehicle and the information of the rear end of the vehicle are important. Therefore, it is desirable that the composite image be configured as shown in FIG. Therefore, the horizontal address LU
T, LUT for vertical address, LUT for memory selector
Are set so that this composite image can be obtained. At this time, which pixel of the image memory is to be brought to which position of the composite image depends on the layout of the camera attached to the vehicle and the observation angle of view, and thus needs to be determined for each vehicle.

Further, as shown in FIG. 4, when the self-vehicle is added to the combined image and displayed, the positional relationship with the surroundings of the vehicle becomes clearer. Specifically, the memory selector LUT 13
-4, a non-existent memory number is written, and when that memory number is accessed, a certain value (for example, 0)
Should be written.

Secondly, the operation of the vehicular image presenting apparatus when the forward garage state SW11-2 is operated and selected will be described. When the driver encounters the forward garage entering scene, the driver enters the forward garage entering state switch SW11− of the vehicle state instruction unit 11.
When 2 is pressed, the image transformation / synthesis unit 13 is set in the forward garage state.

In the forward garage state, generally, information on the side of the vehicle and information on the front end of the vehicle are important. For this reason, it is desirable that the combined image be configured as shown in FIG. Therefore, the LUT for the horizontal address, the LUT for the vertical address, and the LUT for the memory selector are respectively
It is necessary to set so that a composite image as shown in FIG. 6 can be obtained. It should be noted that the position of the composite image in which the pixel of the image memory is to be arranged in association with the layout of the camera attached to the vehicle and the observation angle of view need to be determined for each vehicle.

As a result, the video transformation / synthesis unit 13 functions as described above, and the synthesized image is displayed on the monitor 17. The driver guides the vehicle with reference to the image displayed on the monitor 17 in this manner. When the guidance is completed, the display end switch 15 is pressed to erase the display.

Third, a description will be given of a vehicular image presentation apparatus when the parallel parking state switch 11-3 is operated and selected. When the driver presses the parallel parking state switch 11-3 of the vehicle state instructing unit 11 when encountering the parallel parking scene, the image transformation / synthesis unit 13 is set to the parallel parking state.

In the case of the parallel parking state, generally, information on the side of the vehicle and information on the front and rear ends of the vehicle are important. For this reason, it is desirable that the combined image is configured as shown in FIG. Therefore, the LUT for the horizontal address, the LUT for the vertical address, and the LUT for the memory selector need to be set so that a composite image as shown in FIG. 7 can be obtained. It should be noted that the position of the composite image in which the pixel of the image memory is to be arranged in association with the layout of the camera attached to the vehicle and the observation angle of view need to be determined for each vehicle.

As a result, the video transformation / synthesis unit 13 functions as described above, and the synthesized image is displayed on the monitor 17. The driver guides the vehicle with reference to the image displayed in this manner. When the guidance is completed, the display end switch 15 is pressed to erase the display.

Fourth, a description will be given of a vehicular image presenting apparatus in the case where the state SW11-4 is selected by operating the state of entering an intersection having poor visibility. When the driver encounters a scene approaching an intersection with poor visibility, when the driver presses the state SW11-4 of entering the intersection with poor visibility of the vehicle state instruction unit 11, the image transformation / synthesis unit 13 has poor visibility. It is set to enter the intersection.

When entering an intersection with poor visibility,
Generally, information on the blind spot area immediately before and after the vehicle is important.
For this reason, it is desirable that the combined image be configured as shown in FIG. Therefore, the LUT for the horizontal address, the LUT for the vertical address, and the LUT for the memory selector need to be set so that a composite image as shown in FIG. 8 can be obtained. It should be noted that the position of the composite image in which the pixel of the image memory is to be arranged in association with the layout of the camera attached to the vehicle and the observation angle of view need to be determined for each vehicle.

As a result, the image transformation / synthesis unit 13 functions in the same manner as the switching as described above, and the synthesized image is displayed on the monitor 17. The driver guides the vehicle with reference to the image displayed in this manner. When the guidance is completed, the display end switch 15 is pressed to delete the display.

As described above, the camera 3-
After capturing a plurality of images at the same time using 1 to 3-8 and quantizing them by the A / D converters 5-1 to 5-8, respectively,
While a plurality of videos are acquired by storing the images in the image memories 7-1 to 7-8, one of the driving states of the plurality of vehicles is selected and indicated by the vehicle state instruction unit 11. Here, based on the instructed driving state, the acquired plural images are transformed and
By synthesizing and generating a new image in the image deformation synthesizing unit 13 and displaying the generated image on the monitor 17, it is possible to synthesize and display an accurate image for each scene encountered according to the driving state. it can.

Further, images of a plurality of cameras installed around the vehicle are obtained by using a plurality of pre-formed deformation synthesizing tables.
Deformation and composition processing according to the situation of the vehicle and display are performed, so that optimal video information is provided according to the situation. The application scene can be greatly expanded.

Further, since deformation and synthesis of an image are processed using a lookup table, various deformation synthesis patterns can be easily created only by rewriting data in the table. As a result, when entering a garage, when parking in parallel, when entering an intersection with poor visibility, and the like, the image information around the vehicle, which becomes a blind spot from the driver, is easily deformed, synthesized, and displayed.

(Second Embodiment) FIG. 9 is a diagram showing a configuration of a video display apparatus for a vehicle according to a second embodiment of the present invention, and FIG. FIG. 3 is a diagram illustrating a configuration. The feature of the present embodiment is that, as shown in FIG. 9, a plurality of monitors 17-1 to 17-4 for displaying the video signals synthesized by the video transformation / synthesis unit 13 are provided in the vehicle, and the driver pays attention. This is to provide necessary blind spot information for each direction. Further, as shown in FIG. 10, for each vehicle state indicated by the vehicle state instruction unit 11, four LUT blocks used for address and memory selection are prepared according to the number of monitors. Note that the basic configuration and basic operation of the present embodiment are almost the same as those of the first embodiment, and a description thereof will be omitted.

Next, with reference to FIGS. 10 and 11, a detailed configuration of the video transformation / synthesis unit 13 will be described. FIG. 10, FIG.
As shown in FIG. 1, the video transformation / synthesis unit 13 is provided with four blocks 13-A to 13-D corresponding to the four types of switches of the vehicle state instruction unit 11. Each block is composed of four LUTs (look-up tables). The block selected by the vehicle state instruction unit 11 specifies the horizontal and vertical addresses of an image memory in which video data captured from each camera is stored.

More specifically, for example, the address counter 13
For the coordinate value (x, y) of the composite image indicated by -1-1, the horizontal address LUT 13-3-1, the vertical address LUT 13-2-1, and the memory selector LUT 13-
Data at predetermined addresses in the image memories 7-1 to 7-4 specified by 4-1 are combined into one image. The synthesized image is output from the D / A converter 19-1 connected to each LUT.
To the video signal by the monitor 17-
1 to 17-4.

Here, regarding the block 13-A-1 of the image transformation / synthesis unit 13 connected to the monitor 17-1,
The processing flow will be described. LUT13-3 for horizontal address
The LUT 13-2-1 for the vertical address and the LUT 13-4-1 for the memory selector have the same size as the synthesized display image, and are each composed of a two-dimensional memory consisting of horizontal M × vertical N.

Now, the value A is set in (x, y) of the LUT 13-3-1 for the horizontal address, and the LUT 13-2-1 for the vertical address.
At (x, y), the memory selector LUT 13-4
Assuming that the value C is stored in (x, y) of -1 respectively, the memory selector 13-5-1 selects the image memory C
Is selected, and the value stored at the coordinates (A, B) of the image memory C is output as the coordinates (x, y) of the composite image.

Next, the operation of the vehicle image presentation device will be described with reference to FIGS.

First, the operation of the vehicular image presenting apparatus when the reverse garage entering state switch SW11-1 is operated and selected will be described. When the driver encounters the reverse garage entry scene, the driver enters the reverse garage entry state SW11-
When 1 is pressed, the image transformation / synthesis unit 13 is set to the backward garage state. In the case of a backward garage, generally, information on the side of the vehicle and information on the rear end of the vehicle are important.
At this time, the driver twists his / her body and checks the back in order to visually recognize the information behind. Therefore, it is natural to present a rear image as shown in FIG. 12 on the monitor 17-4 behind the driver.

At this time, the LUT for the horizontal address, the LUT for the vertical address, and the LUT for the memory selector are set so that a composite image of them can be obtained. In this case, since only one LUT block A uses 13-A-4, data indicating that it is not used is recorded in the other LUT blocks. This is because the address counter is 1
A value other than .about.M or 1-N may be set so as to access outside the target image. Also, which pixel of the image memory is to be brought to which position of the composite image depends on the layout of the camera attached to the vehicle and the observation angle of view, and therefore needs to be determined for each vehicle.

As shown in FIG. 15, when the display of the own vehicle is added to the composite image, the positional relationship with the surroundings becomes clearer. This is the LUT 13-4-4 for memory selector,
A non-existent memory number may be written, and when that memory is accessed, a constant value (for example, 0) may be written. The driver guides the vehicle with reference to the image displayed in this manner. After the guidance is completed, the display end switch 15 is pressed to erase the display.

As described above, the operation for entering the reverse garage is performed by the video transformation / synthesis unit 13-A-4 in accordance with the flowchart shown in FIG. Second, the case of forward garage storage will be described. When the driver encounters the forward garage putting scene, the driver presses the forward garage putting state SW 11-2 of the vehicle state instruction unit 11.

In the case of forward garage storage, the image deformation synthesizing section 13 is set for forward garage storage. In the case of a forward garage, generally, information on the side of the vehicle and information on the front end of the vehicle are important. For this reason, as shown in FIG. 13, the image of the vehicle left is displayed on the monitor 2 at the front left of the driver, the image of the vehicle right is displayed on the monitor 3 at the driver right, and the Morita 1 is displayed on the front of the driver. It is desirable to present those composite images. At this time, the LUT for the horizontal address, the LUT for the vertical address, and the LUT for the memory selector are set so that these composite images can be obtained. In this case, three blocks 13-B-1, 2, and 3 of the LUT block B are used. Which pixel of the image memory is to be brought to the position of the synthesized image throat depends on the layout of the camera attached to the vehicle and the observation angle of view, and therefore needs to be determined for each vehicle.

The driver guides the vehicle with reference to the image displayed in this manner. After the guidance is over,
Pressing the display end switch 15 deletes the display from the monitor.

Third, the case of parallel parking will be described. When encountering the scene of parallel parking, the driver presses the parallel parking state SW 11-3 of the vehicle state instruction unit 11. The image transformation / synthesis unit 13 is set for parallel parking. In the case of parallel parking, generally, information on the side of the vehicle and information on the front and rear ends of the vehicle are important. In addition, the driver evenly looks at the front end and the rear end of the vehicle to check the surrounding conditions. For this reason, as shown in FIG. 14, the composite image of the entire surroundings is displayed on the monitor 1 in front of the driver, the image of the front left is displayed on the monitor 3 on the left side of the driver, and the Morita on the right side of the driver, as shown in FIG. It is desirable to present an image of the front right to 3 and an image of the rear of the vehicle to the monitor 4 behind the driver. Therefore, the LUT for the horizontal address, the LUT for the vertical address, and the LUT for the memory selector are set so that these composite images can be obtained. In this case, four blocks 13-C-1, 2, 3, and 4 of the LUT block C are used. At this time, the position of the pixel in the image memory to be brought to the position of the throat of the composite image depends on the layout of the camera attached to the vehicle and the observation angle of view, and thus needs to be determined for each vehicle.

The driver guides the vehicle with reference to the image displayed in this manner. After the guidance is over,
Pressing the display end switch 15 deletes the display from the monitor. Fourth, a case where the vehicle approaches an intersection with poor visibility will be described. When approaching an intersection with poor visibility,
Intersection entry state SW1 with poor visibility of vehicle state instruction unit 11
Press 1-4.

In this case, the image transformation / synthesis unit 13 is set for an intersection with poor visibility. When entering an intersection with poor visibility, information on the blind spot area immediately to the left of the vehicle is generally important. Therefore, the driver shakes his or her head left and right to visually check the blind spot area. In such a case, FIG.
As shown in FIG. 5, it is desirable to present images in each direction on the left and right monitors of the driver. Therefore, the horizontal address L
UT, vertical address LUT, memory selector LUT
Are set so that these composite images can be obtained. In this case, two blocks 13-D-2 and 3 of the LUT block D are used. At this time, the position of the pixel in the image memory and the position of the pixel in the composite image
Since it depends on the layout of the camera attached to the vehicle and the observation angle of view, it must be determined for each vehicle.

The driver guides the vehicle with reference to the image displayed in this manner. After the guidance is over,
Pressing the display end switch 15 deletes the display from the monitor. As described above, the cameras 3-1 to 3-3 installed in the vehicle
-8, a plurality of images are simultaneously captured and quantized by the A / D converters 5-1 to 5-8, respectively, and stored in the image memories 7-1 to 7-8. Is acquired, and a plurality of acquired images are deformed and synthesized in accordance with the driving states of the plurality of vehicles, and a new image is formed by the image deformation synthesizing unit 1.
3 and the generated video is output to a plurality of monitors 17-
Since the images are displayed in association with 1 to 17-4, accurate images can be simultaneously synthesized and displayed for each scene encountered. As a result, for example, when the driver turns backward, a blind spot image behind the driver can be seen, so that surrounding image information required by the driver can be presented on the monitor.

Furthermore, since image conversion is performed using a look-up table, an ultra-wide-angle image can be deformed without distortion, and only a region of interest can be extracted.
Therefore, the entire periphery of the vehicle can be monitored by, for example, four cameras, and the number of cameras constituting the system can be reduced.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a vehicular video presentation device according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a switch panel of a vehicle state instruction unit 11;

FIG. 3 shows four blocks 13-A in a video transformation / synthesis unit 13 corresponding to four types of switches of a vehicle state instruction unit 11.
It is a figure showing that ~ 13-D is prepared.

FIG. 4 is a diagram showing an image displayed on a monitor when the vehicle is in a backward garage state.

FIG. 5 is a flowchart for explaining the operation of the vehicular image presentation device when entering the reverse garage.

FIG. 6 is a diagram showing an image displayed on a monitor in a forward garage state.

FIG. 7 is a diagram showing an image displayed on a monitor in a parallel parking state.

FIG. 8 is a diagram showing an image displayed on a monitor when the user enters an intersection with poor visibility.

FIG. 9 is a diagram illustrating a configuration of a vehicular video presentation device according to a second embodiment of the present invention.

FIG. 10 is a diagram showing a block configuration of a video transformation / synthesis unit 13;

11 shows four blocks 13- in the video transformation / synthesis unit 13 corresponding to the four types of switches of the vehicle state instruction unit 11. FIG.
It is a figure showing that A-13D is prepared.

FIG. 12 is a diagram showing an image displayed on a monitor in a backward garage state.

FIG. 13 shows a monitor 17-2 in a forward garage state.
(A), monitor 17-1 (b), monitor 17-3 (c)
FIG. 3 is a diagram showing an image displayed on the screen.

FIG. 14 shows a monitor 17-2 in a parallel parking state.
(A), monitor 17-1 (b), monitor 17-3
(C) is a diagram showing an image displayed on the monitor 17-4 (d).

FIG. 15 is a diagram showing an image displayed on the monitor 17-2 (a) and the monitor 17-3 (b) when entering an intersection with poor visibility.

[Explanation of symbols]

 3-1 to 3-8 Camera 5-1 to 5-8 A / D conversion unit 7-1 to 7-8 Image memory 11 Vehicle state instruction unit 13 Image transformation / combination unit 17 Monitor

Claims (4)

[Claims] 1. An image acquisition means installed in a vehicle for acquiring a plurality of images at the same time; a vehicle state instruction means for selecting and instructing one of a plurality of operation states of the vehicle; Based on the video deformation and synthesis of multiple acquired images to generate a new video
An image presentation device for a vehicle, comprising: synthesis means; and image display means for displaying the generated image. 2. An image acquisition means installed in a vehicle for acquiring a plurality of images at the same time, and generating and generating a new image by transforming and synthesizing the plurality of images acquired according to a driving state of the plurality of vehicles. And a plurality of video display means for displaying the generated video. 3. The image transformation / synthesizing means includes: retreating a vehicle and parking at a fixed position; moving the vehicle forward and stopping at a fixed position; performing parallel parking; The image presentation device for vehicles according to claim 1 or 2, wherein a new image corresponding to all scenes or some scenes of the approach scene is generated. 4. The apparatus according to claim 1, wherein said image deforming / combining means deforms and synthesizes the plurality of acquired images so as to be mutually continuous to generate a new image. The vehicle image presentation device according to one of the above aspects.