JP4791222B2 - Display control device - Google Patents

Description

  The present invention relates to a display control device that displays on a display device an image taken by a photographing device provided in a vehicle.

As a conventional display control device, by dividing the area of the video captured by the camera for viewing the surroundings of the vehicle, and changing the format conversion method according to the importance of each divided area, There is one that balances the transmission capacity from the device to the display device and the resolution by making the important region in the video high resolution and the other region low resolution (for example, see Patent Document 1). .
JP 2005-20538 A

  However, in the conventional display control device, since the important area in the video is fixed, if the important area in the video moves according to the running state of the vehicle, the important area in the video is displayed. There was a problem that the resolution could not be made higher than in other areas.

  The present invention has been made to solve the conventional problem, and even when an important area in the video moves, the important area in the video can be set to a higher resolution than other areas. An object is to provide a display control device.

The display control device according to the present invention is a display control device that displays on a display device an image captured by an imaging device provided in a vehicle, and is configured to divide a region of the image captured by the imaging device into a plurality of blocks. And an important area determination means for determining an important area in the video imaged by the imaging device based on a steering angle of a steering wheel of the vehicle detected by a steering angle sensor provided in the vehicle, The thinning rate determining means for determining the thinning rate of the blocks in the important area corresponding to the traveling direction of the vehicle in the photographed area to be smaller than the thinning rate of other blocks, and the thinning rates determined by the thinning rate determining means , and a data decimating means for decimating the image data corresponding to each block, the area dividing means, said data reducing means The number of pixels of the image represented by the thinned video data to divide the area of the image captured by equal as the imaging device in each of the blocks I.

With this configuration, the display control device of the present invention determines the thinning rate for each block based on the steering angle of the steering wheel, so that even if an important area in the video moves, an important Regions can be made higher resolution than other regions. Furthermore, the display control apparatus of the present invention can make an important area in the video in which the traveling direction of the vehicle is captured higher in resolution than the other areas even when the traveling direction of the vehicle changes.

  Further, the data thinning means interpolates the luminance component of each pixel before the thinning at a ratio of a region occupied by the pixel after thinning out of a region occupied by each pixel before thinning corresponding to each pixel after thinning. May be the luminance component of the pixel after the thinning.

  With this configuration, the display control apparatus of the present invention can appropriately interpolate the luminance component of each pixel of the video represented by the video data after thinning.

  Further, the data thinning means interpolates the chromaticity component of each pixel before thinning at a ratio of a region occupied by the pixel after thinning out of a region occupied by each pixel before thinning corresponding to each pixel after thinning This may be used as the chromaticity component of the pixel after the thinning.

  With this configuration, the display control apparatus of the present invention can appropriately interpolate the chromaticity component of each pixel of the video represented by the video data after thinning.

  Further, the video display system of the present invention includes a photographing unit provided in a vehicle, a region dividing unit that divides a region of a video photographed by the photographing device into a plurality of blocks, and a steering angle sensor provided in the vehicle. The decimation rate determining means for determining the decimation rate for each block based on the steering angle of the steering wheel of the vehicle detected by the method, and the decimation rate determined by the decimation rate determining means, corresponding to each block The data thinning means for thinning out the video data to be processed and the display means for displaying the video represented by the video data of each block thinned out by the data thinning means.

  With this configuration, since the video display system of the present invention determines the thinning rate for each block based on the steering angle of the steering wheel, even if the important area in the video moves, Regions can be made higher resolution than other regions.

  The present invention can provide a display control device having an effect that even when an important area in a video moves, the important area in the video can have a higher resolution than other areas. .

  Embodiments of the present invention will be described below with reference to the drawings. In the present embodiment, an example in which the display control device according to the present invention is configured by an ECU (Electronic Control Unit) and applied to a video display system mounted on a vehicle will be described.

  An image display system according to an embodiment of the present invention is shown in FIG.

  As shown in FIG. 1, the video display system 1 includes a camera 2, a video signal generation device 3, a display device 4, and a video or video signal generation device 3 captured by the camera 2 attached to the rear of the vehicle. ECU5 which displays the image | video which the output image | video signal represents on a display apparatus.

  As shown in FIG. 2, the camera 2 is attached to the vehicle so as to photograph the rear of the vehicle, and generates a video signal representing the photographed video.

  In FIG. 1, a video signal generating device 3 is constituted by a navigation device, a TV tuner, or the like, and generates a video signal representing a navigation video, a TV video, or the like. The display device 4 displays the video represented by the video signal on a screen such as a cathode ray tube or a liquid crystal.

  The ECU 5 is a DSP (Digital Signal Processor) 10 programmed to perform image processing on a video signal representing a video photographed by the camera 2, and a flash memory 11 that stores parameters and the like that the DSP 10 refers to perform image processing. A video memory 12 that stores video data obtained from a video signal when the DSP 10 performs image processing, a video signal subjected to image processing by the DSP 10, and a video signal output from the video signal generation device 3. A switch 13 for selecting one of the video signals, a video amplifier 14 for amplifying the video signal selected by the switch 13, a communication module 16 for performing communication via a CAN (Controller Area Network) network 15, and a CPU (Central Processing Unit) 17.

  Connected to the CAN network 15 are an ECU (not shown) that manages the state of the transmission, a steering angle sensor 20 that detects the steering angle of the steering wheel of the vehicle, and the like.

  The CPU 17 controls each unit of the ECU 5 such as the DSP 10 and the switch 13 by reading a program stored in a ROM (not shown) into a RAM (not shown) and executing the program read into the RAM.

  For example, the CPU 17 acquires transmission information indicating the state of the transmission of the vehicle via the communication module 16, and when the transmission information indicates that the transmission selects the back gear, the DSP 10 performs image processing. The applied video signal is selected by the switch 13.

  Further, when the transmission information indicates that the transmission selects a gear other than the back gear, the CPU 17 causes the switch 13 to select the video signal output from the video signal generating device 3. Yes.

  The DSP 10 divides the area of the image captured by the camera 2 into a plurality of blocks, determines a thinning rate for each block based on the steering angle detected by the steering angle sensor 20, and assigns each block to the block with the determined thinning rate. Thinning processing for thinning out video data obtained from the corresponding video signal is performed.

  Hereinafter, an example will be described in which the DSP 10 divides a video area having 768 pixels in the horizontal direction into 16 blocks in the horizontal direction and thins it out to 512 pixels.

  Note that the DSP 10 may divide the area of the video shot by the camera 2 into a plurality of blocks in the vertical direction, and divide the area of the video shot by the camera 2 into a plurality of blocks in the horizontal and vertical directions. You may make it do.

  The flash memory 11 stores in advance a thinning rate map that represents the number of pixels of each block and a thinning rate corresponding to each predetermined steering angle.

  For example, as shown in FIG. 3, when the steering angle is in the straight traveling direction, the central portion 51 of the image 50 photographed by the camera 2 is an important region, so the thinning rate map for the steering angle in the straight traveling direction is The thinning rate is set to be larger from the block near the center 51 to the end block.

  On the other hand, as shown in FIG. 4, when the steering angle is in the right turn direction, the right vicinity 53 where an obstacle is first projected when moving backward is an important area in the image 52 taken by the camera 2. In the decimation rate map for the steering angle in the right turn direction, the decimation rate is set to increase as it goes from the block near the right 53 to the end block.

  In this embodiment, as shown in FIGS. 3 and 4, each thinning rate map is set so that the number of pixels of the video represented by the video data thinned out by the DSP 10 is equal in each block. However, as shown in FIG. 5, it may be set so that the area of the video shot by the camera 2 is equally divided into blocks.

  The DSP 10 selects a decimation rate map corresponding to the steering angle detected by the steering angle sensor 20 via the communication module 16 from the decimation rate map stored in the flash memory 11, and sets each decimation rate map based on the selected decimation rate map. The number of pixels of the block and the thinning rate are determined.

  In thinning out each block, the DSP 10 interpolates each component of each pixel before thinning at the ratio of the region occupied by the pixel after thinning out of the region occupied by each pixel before thinning corresponding to each pixel after thinning. This is used as each component of the pixel after thinning.

  For example, when the video data is expressed in the YUV format, the DSP 10 interpolates the luminance component and chromaticity component of each pixel before thinning out, and sets the luminance component and chromaticity component of the pixel after thinning out. .

  In the example shown in FIG. 6, the DSP 10 has a ratio 3: 1 of the area occupied by the pixel 60 after thinning out of the area occupied by the pixels A and B before thinning corresponding to the pixel 60 after thinning, and before the thinning. Interpolated luminance components and chromaticity components of the pixels A and B are used as the luminance component and chromaticity component of the pixel 60 after thinning.

  Similarly, the DSP 10 uses the ratio of the area occupied by the pixel 61 after thinning out of the area occupied by the pixels B and C before thinning corresponding to the pixel 61 after thinning, and the respective pixels B and C before thinning out. Are obtained by interpolating the luminance component and the chromaticity component of the pixel 61 after the thinning, and the luminance component and the chromaticity component of the pixel 61 after the thinning are obtained. The luminance ratio and the chromaticity component of the pixel 62 after the thinning are obtained by interpolating the luminance component and the chromaticity component of each of the pixels C and D before the thinning at a ratio 1: 3 of the area occupied by the pixels 62.

  As described above, the DSP 10 and the flash memory 11 constitute an area dividing unit and a thinning rate determining unit in the present invention, and the DSP 10 constitutes a data thinning unit.

  In FIG. 1, the DSP 10 stores the thinned video data in the video memory 12, converts the stored video data so that it represents a video shot from above the position of the camera 2, and the bumper is shot. A bird's-eye view process is performed to correct a portion that is curved and photographed at a position close to the vehicle, such as a portion that has been cut.

  Specifically, the DSP 10 selects a viewpoint conversion map corresponding to the steering angle detected by the steering angle sensor 20 via the communication module 16 from the viewpoint conversion map stored in the flash memory 11, and selects the selected viewpoint conversion. The position of each pixel is changed based on the map.

  The viewpoint conversion map is stored in advance in the flash memory 11 in correspondence with each predetermined steering angle, like the thinning rate map. Further, since the video data is thinned out by the DSP 10, each viewpoint conversion map is set according to each thinning rate map.

  Further, the DSP 10 performs a guideline superimposing process for superimposing information such as a guideline used for backward parking support on the video data subjected to the overhead view process.

  Note that the video represented by the video data subjected to the guideline superimposing process is not uniform in horizontal scale between the blocks due to the thinning process, so that the DSP 10 superimposes information representing the position of the own vehicle. Information representing the position of the host vehicle is adjusted in the horizontal direction in accordance with the steering angle detected by the steering angle sensor 20.

  Thus, since the DSP 10 performs the bird's-eye view process and the guideline superimposing process on the video data subjected to the thinning process, the information amount of the video data subjected to the bird's-eye view process and the guideline superimposing process is reduced, and the bird's-eye view process and the guideline superimposing process are performed. The processing load is reduced.

  The operation of the video display system 1 configured as described above will be described with reference to FIG.

  First, the rear of the vehicle is photographed by the camera 2 (S1), and the steering angle detected by the steering angle sensor 20 is acquired by the DSP 10 via the communication module 16 (S2).

  Next, a thinning rate map corresponding to the steering angle is selected by the DSP 10 from the thinning rate map stored in the flash memory 11 (S3). Based on the selected thinning rate map, the region of the video imaged by the camera 2 is selected. Is divided into a plurality of blocks by the DSP 10 (S4), and the thinning rate of each block is determined by the DSP 10 (S5).

  Next, the DSP 10 performs a thinning process for thinning out video data obtained from the video signal corresponding to each block at the determined thinning rate (S6), and the video data subjected to the thinning process is stored in the video memory 12. The

  Next, a viewpoint conversion map corresponding to the steering angle is selected from the viewpoint conversion map stored in the flash memory 11 by the DSP 10 (S7), and an overhead view process for changing the position of each pixel based on the selected viewpoint conversion map is performed. The process is performed by the DSP 10 (S8), and then the guideline superimposing process is performed by the DSP 10 (S9). Since the video signal subjected to the guideline superimposing process represents a video obtained by photographing the rear of the vehicle, the DSP 10 performs the horizontal reversal process on the video signal so that the video represented by the video signal subjected to the guideline superimposing process is reversed left and right. It is desirable to apply.

  Next, when the transmission information input to the CPU 17 via the communication module 16 indicates that the back gear is selected (S10), the switch 17 is controlled by the CPU 17 to select the DSP 10 side, The video represented by the video signal subjected to the guideline superimposing process by the DSP 10 is displayed on the display device 4 (S11).

  On the other hand, if the transmission information indicates that a gear other than the back gear is selected (S10), the switch 17 is controlled by the CPU 17 to select the video signal generating device 3 side, and the video signal generating device 3 is selected. The video represented by the video signal output from is displayed on the display device 4 (S12).

  Since the video display system 1 according to the embodiment of the present invention determines the thinning rate for each block based on the steering angle of the steering wheel of the vehicle, it is a case where an important area in the video has moved. However, an important area in the video can be set to a higher resolution than other areas.

  In the present embodiment, an example in which the video display system 1 displays the video captured by the single camera 2 on the display device 4 has been described. However, the video display system 1 is located behind or on the side of the vehicle. You may make it display the image | video image | photographed with the some attached camera on the display apparatus 4. FIG.

  In this case, the DSP 10 is configured to perform a thinning process or the like by associating an area of a video image captured by each camera with each block.

  As described above, the display control apparatus according to the present invention has an effect that even when an important area in the video moves, the important area in the video can have a higher resolution than other areas. For example, it is useful as a display control device or the like for displaying a video image taken by an imaging device provided in a vehicle on a display device.

The block diagram of the video display system in one embodiment of this invention Mounting diagram of a camera constituting a video display system in an embodiment of the present invention 1 is a first conceptual diagram for explaining a block before thinning and a block after thinning by a DSP constituting a video display system according to an embodiment of the present invention; The 2nd conceptual diagram for demonstrating the block before thinning by the DSP which comprises the video display system in one embodiment of this invention, and the block after thinning FIG. 3 is a third conceptual diagram for explaining a block before thinning and a block after thinning by the DSP constituting the video display system in one embodiment of the present invention. The conceptual diagram for demonstrating the interpolation of the pixel after thinning-out by DSP which comprises the video display system in one embodiment of this invention The flowchart for operation | movement description of the video display system in one embodiment of this invention

DESCRIPTION OF SYMBOLS 1 Video display system 2 Camera 3 Video signal production | generation apparatus 4 Display apparatus 5 ECU
10 DSP
11 Flash memory 12 Video memory 13 Switch 14 Video amplifier 15 CAN network 16 Communication module 17 CPU
20 Steering angle sensor

Claims (4)

In a display control device for displaying on a display device an image photographed by a photographing device provided in a vehicle,
Area dividing means for dividing an area of the video imaged by the imaging apparatus into a plurality of blocks;
An important area determination means for determining an important area in an image photographed by the photographing device based on a steering angle of a steering wheel of the vehicle detected by a steering angle sensor provided in the vehicle;
A decimation rate determining means for determining a decimation rate of blocks in the important area corresponding to the traveling direction of the vehicle in a captured area to be smaller than a decimation rate of other blocks;
Data thinning means for thinning video data corresponding to each block at each thinning rate determined by the thinning rate determining means ,
The area dividing means divides the area of the video imaged by the imaging apparatus so that the number of pixels of the video represented by the video data thinned out by the data thinning means is equal in each block. .   The display control apparatus according to claim 1, wherein the important area determination unit sets an area in which an obstacle is projected first when traveling in an image as an important area. The data thinning means interpolates the luminance component of each pixel before the thinning at a ratio of the area occupied by the pixel after thinning out of the area occupied by each pixel before thinning corresponding to each pixel after thinning. the display control device according to claim 1 or claim 2, characterized in that the luminance component of a pixel after the thinning. The data thinning means interpolates the chromaticity component of each pixel before thinning at a ratio of the area occupied by the pixel after thinning out of the area occupied by each pixel before thinning corresponding to each pixel after thinning the display control device according to claim 1 or claim 2, characterized in that a chromaticity component of the pixel after the thinning.

Images