KR20180001869A - Image Improving Apparatus for AVM System and Improving Method thereof - Google Patents

Abstract

The present invention relates to an image improvement apparatus for an around view monitoring (AVM) system and a control method thereof, which enable a user not to feel unnatural for a synthesized AVM synthetic image by correcting brightness and colors of image information acquired from each camera area of the AVM system. According to an embodiment of the present invention, the image improvement apparatus comprises: a camera photographing a first channel image, a camera photographing a second channel image, a camera photographing a third channel image, and a camera photographing a fourth channel image; an image information acquisition unit acquiring image information of the first to fourth channels; a channel selection unit selecting any one channel among the first to fourth channels; a first correction region setting unit setting a correction region in a selected channel; a second correction region setting unit setting a correction region in a channel adjacent to the selected channel; a parameter extraction unit extracting a parameter from image information of the correction region, which is set in the first and second correction region setting units; a parameter correction unit correcting the extracted parameter; and an image outputting unit outputting the AVM synthetic image, which is corrected by reflecting the corrected parameter. The parameter correction unit calculates an average value of the parameter extracted from first and second correction regions, and applies the same to a parameter of the selected channel to improve the AVM synthetic image.

Description

 [0001] Image Improving Apparatus for AVM System and Improving Method [

The present invention relates to an apparatus and method for improving an image of an AVM system, and more particularly, to an apparatus and method for improving an image of an AVM system by reducing the brightness and color of image information obtained in each camera area of an AVM .

Black box and rear camera technologies have been developed as camera image monitoring technologies related to vehicles. In order to distinguish the vehicle from the front, back, left, and right directions, the black box and the rear camera have a problem of poor scalability because they only acquire images in one direction and utilize them. Around View Monitoring) system is being released. AVM system refers to a system equipped with a function to detect objects around 360 degrees around a vehicle.

In general, the AVM system is equipped with four cameras at the front and rear of the vehicle, and at the bottom of the left and right side mirrors, so that the front, rear, left and right sides of the vehicle can be viewed through the display unit located in the center fascia. The images acquired through the camera are synthesized and can be viewed on a single monitor, as if looking down at the vehicle from the sky. This provides the driver with a safe driving environment, including vehicle surroundings, obstacle information, danger warning and parking assistance, through the intuitive Top View image. Since the real-time parking trajectory according to the vehicle operation is displayed on the screen, it is convenient for the driver to park the vehicle even when viewing the screen.

However, since the conventional AVM system synthesizes a plurality of pieces of image information and outputs them to a single screen, there is a problem that an unnatural AVM composite image is output depending on the brightness and color difference of the image information acquired by the camera in each region.

An object of the present invention is to provide an apparatus for smoothly improving an unnatural AVM composite image according to a difference in brightness and color caused by combining a plurality of image information, and a method of controlling the operation of the apparatus.

According to an embodiment of the present invention, there is provided a method for capturing a first channel image, a second channel image capturing camera, a third channel image capturing camera, and a fourth channel image capturing method, camera; An image information acquiring unit acquiring image information of the first channel to the fourth channel; A channel selector for selecting one of the first to fourth channels; A first correction area setting unit for setting a correction area in the selected channel; A second correction area setting unit for setting a correction area in a channel adjacent to the selected channel; A parameter extracting unit for extracting a parameter from the image information of the correction area set by the first correction area setting unit and the second correction area setting unit; A parameter correcting unit for correcting the extracted parameter; And an image output unit for outputting the corrected AVM composite image by reflecting the corrected parameter, wherein the parameter correction unit calculates an average value of the parameters extracted in the first correction area and the second correction area, And the AVM composite image is improved by applying the AVM system to the AVM system.

Here, the parameter extracted by the parameter extracting unit may include a first parameter for the brightness of the correction region and a second parameter for the color of the correction region.

The correction area set by the first correction area setting part and the second correction area setting part may be a lower area of the channel image,

Further, the correction area set by the second correction area setting part may be an area adjacent to the correction area set by the first correction area setting part.

In addition, the correction area set by the second correction area setting unit may be variable according to time, external environment, driving mode, or user definition.

According to an embodiment of the present invention,

The first correction area setting unit may weight the extracted parameters in the correction area set by the first correction area setting unit.

According to another embodiment of the present invention, there is provided an image processing method comprising the steps of: (a) acquiring image information of a first channel to a fourth channel from a plurality of cameras installed in a vehicle; (b) a channel selecting step of selecting any one of the first to fourth channels; (c) a first correction region setting step of setting a correction region in the selected channel; (d) a second correction region setting step of setting a correction region in a channel adjacent to the selected channel; (e) a parameter extracting step of extracting a parameter from the set correction area; (f) a parameter correction step of correcting the extracted parameter; and (g) outputting a corrected AVM composite image by reflecting the corrected parameter, wherein the parameter correction step includes the steps of (f-1) modifying the parameters extracted from the first correction area and the second correction area And (f-2) an input step of applying an average value of the parameters to the selected channel.

The parameter extracted in the (e) parameter extraction step may include a first parameter for the brightness of the correction area and a second parameter for the color of the correction area.

The correction region set in the (c) first correction region setting step and (d) the second correction region setting step may be a lower region of the channel image,

The correction area set in the second correction area setting step (d) may be an area adjacent to the correction area set in the (c) first correction area setting step.

In addition, (d) in the second correction region setting step, the range of the second correction region may be variable according to time, an external environment according to weather, a driving mode, or a user definition.

The method may further include a weighting step of weighting the parameters extracted from the correction area set in the first correction area setting step (c) after the step (e) of extracting the parameters.

According to the embodiments of the present invention described above, it is possible to reduce a sense of heterogeneity in the vicinity of an interface generated according to the synthesis of images in an image output through the AVM system.

In the present invention, not only the unnaturalness of the AVM interface but also the unnaturalness of the entire AVM screen can be solved,

As a parameter for correction, parameters of brightness and color are extracted at the same time and applied as a target of correction, which has an advantage that the quality of output image can be remarkably improved.

1 is a schematic diagram of an AVM system according to an embodiment of the present invention.
2 is a block diagram illustrating an image enhancement apparatus of an AVM system according to an embodiment of the present invention.
3 is a block diagram illustrating an ISP according to an embodiment of the present invention.
4 to 6 are conceptual diagrams illustrating a method of setting a correction area according to an embodiment of the present invention.
7 is a block diagram illustrating an image enhancement method of an AVM system according to an embodiment of the present invention.
8 is a block diagram illustrating an image enhancement method of an AVM system according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an apparatus and method for improving an image of an AVM system according to the present invention will be described in detail with reference to the accompanying drawings. The embodiments are provided so that those skilled in the art can easily understand the technical spirit of the present invention, and thus the present invention is not limited thereto. In addition, the matters described in the attached drawings may be different from those actually implemented by the schematic drawings to easily describe the embodiments of the present invention.

In the meantime, each constituent unit (for example, an image information acquiring unit or the like) described below is only an example for implementing the present invention. Thus, in other implementations of the present invention, other components may be used without departing from the spirit and scope of the present invention.

In addition, each component may be implemented solely by hardware or software configuration, but may be implemented by a combination of various hardware and software configurations performing the same function. Also, two or more components may be implemented together by one hardware or software.

Also, the expression " comprising " is intended to merely denote that such elements are present as an expression of " open ", and should not be understood to exclude additional elements.

Further, when a component is referred to as being connected or connected to another component, it may be directly connected or connected to the other component, but it should be understood that there may be other components in between.

Also, the expressions such as 'first, second', etc. are used only to distinguish a plurality of configurations, and do not limit the order or other features between configurations.

1 is a schematic diagram of an AVM system according to an embodiment of the present invention. 2 is a block diagram illustrating an image enhancement apparatus of an AVM system according to an embodiment of the present invention. 3 is a block diagram illustrating an ISP according to an embodiment of the present invention.

Referring to FIG. 1, an AVM system according to an embodiment of the present invention synthesizes images of a first channel CH100, a second channel CH200, a third channel CH300, and a fourth channel CH400, Can be output to the same image as the top view which is viewed from the sky.

The AVM system according to an embodiment of the present invention is a system in which a camera for storing an external image of a vehicle is mounted and a rectangular shape that is not visible to a driver at the time of driving or parking through the display device inside the vehicle And may be a system including a part for assisting the AVM and the AVM.

2, an image enhancement apparatus of an AVM system according to an embodiment of the present invention includes a camera 100 for capturing a first channel (CH100) image, a camera 200 for capturing a second channel (CH200) image, A camera 300 for capturing an image of a third channel (CH300), and a camera 400 for capturing a fourth channel (CH400) image; An image information obtaining unit 10 for obtaining image information of the first channel CH100 to the fourth channel CH400; A channel selector 20 for selecting any one of the first to fourth channels CH100 to CH400; A first correction area setting part (31) for setting a correction area in the selected channel; A second correction area setting part (32) for setting a correction area in a channel adjacent to the selected channel; A parameter extracting unit (40) for extracting a parameter from the image information of the correction region set by the first correction region setting unit (31) and the second correction region setting unit (32); A parameter correcting unit (50) for correcting the extracted parameter; And an image output unit 60 for outputting the corrected AVM composite image by reflecting the corrected parameter.

Here, the parameter correcting unit 50 may improve the AVM composite image by calculating an average value of the parameters extracted from the first correction area and the second correction area, and applying the calculated average value to the parameters of the selected channel.

In the AVM system, a camera is indispensably mounted. At least one camera may be installed, and preferably at least four cameras are installed, so that a video image of the surroundings of the vehicle can be placed in the camera 360 degrees around the camera.

The camera of the present invention may be a conventional CCD / CMOS camera. In the above embodiment including FIG. 2, one camera is provided for each channel, but the present invention is not limited thereto.

Here, the first channel CH100 is a front region of the vehicle, the second channel CH200 is a right side region of the vehicle, the third channel CH300 is a rear region of the vehicle, and the fourth channel CH400 is a It may mean the left room area.

The image information acquisition unit 10 is a component for acquiring image information of the first channel CH100 to the fourth channel CH400. The channel selection unit 20 selects the first channel CH100 4 channel (CH400), which is the previous stage of the correction area setting.

As will be described later, a key technical element of the present invention is to select a target channel, correct the image parameter values for both channels of the target channel along with the target channel, apply the correction value to the target camera To improve the unnaturalness of the AVM composite image. The selection operation of the channel selection unit 20 is important because both side channels are selected based on the target channel.

The correction region setting unit 30 includes a first correction region setting unit 31 and a second correction region setting unit 32. [ The first correction area setting unit 31 is configured to set a correction area in a channel (target channel) selected by the channel selector 20. The second correction area setting unit 32 sets a correction area in a channel Is a component that sets a correction area in the image.

The parameter extracting unit 40 extracts the parameters from the image information of the correction region set by the first correction region setting unit 31 and the second correction region setting unit 32. [ That is, instead of extracting the parameters only from the channel selected by the channel selection unit 20, the parameters are also extracted from the channels on both sides of the selected channel to correct the image.

As described above, the parameter correction unit 50 improves the AVM composite image by calculating the average value of the extracted parameters and applying it to the parameters of the selected channel (target channel).

Another principal technical feature of the present invention is that the parameter extracted by the parameter extracting unit 40 includes a first parameter for the brightness of the correction area and a second parameter for the color of the correction area will be. More specifically, the first parameter may mean a parameter for brightness (or brightness) in the three elements of the color. The second parameter may mean color information obtained by receiving the image in the RGB and / or YUV manner. For reference, RGB and YUV are mutually convertible.

Even with the first parameter, which is a parameter for brightness, the unnaturalness in the AVM composite image can be somewhat resolved. However, in the present invention, it is possible to acquire a more natural AVM composite image by extracting and correcting the second parameter which is a parameter for color. For example, when the vehicle is parked, a yellow or blue parking line on the floor surface of the parking space is displayed on the AVM composite screen. When using only the first parameter, the heterogeneity of the brightness in the synthesized image can be solved, but the heterogeneity of the color can not be solved. On the contrary, when using only the second parameter, the heterogeneity of color in the synthesized image can be solved, but the sense of heterogeneity in brightness can not be solved. In order to solve such a problem, in the present invention, at least two or more parameters are used to correct image information obtained from a camera. In particular, it is preferable to extract parameters for brightness and color as at least two parameters in terms of ease of user recognition.

To facilitate understanding of the present invention, the principle of an image signal processor (ISP) will be briefly described with reference to FIG.

The camera of the present invention may be provided with an image pickup device such as a CCD or a CMOS Image Sensor (CIS). The color filter is included in the image, and the R, G, and B information of the image are usually input in the form of 8Bit Bayer RGB Data do. Raw data inputted in 8 bits by the combination of the first RGB is interpolated so as to have data of, for example, 24 bits or 30 bits so as to have a larger number of data in one pixel.

In this case, data can not be extracted as a component of an accurate wavelength band due to distortion of a color filter. A value including such a distortion component is extracted, and color correction is performed so as to have original data as an inverse coefficient value thereof .

In addition, a display device such as a CRT or a monitor has an inherent distortion value, and a gamma correction operation is performed as a processing method for correcting the distortion value of the display device in advance.

Next, color space conversion (color space conversion) is performed, which means that the RGB scale data is converted into a YCbCr scale. Since RGB image data has both luminance and color components, it is difficult to control only luminance or color. Therefore, when the luminance is to be controlled, the Y data is controlled. When the color is to be adjusted, the YCbCR scale is controlled to control the CbCr data. For reference, the format of YCbCr Scale can be variously selected as 4: 2: 0, 4: 2: 2, 4: 4:

Histogram Equalization refers to a method in which a histogram is generated for each value of an image signal output from a CMOS image sensor and then uniformly stretched by adjusting the MAX value to 255 when the maximum value is small . As a result, CMOS image sensors can compensate for characteristics in which the low-intensity characteristics are not as good as those of the CCD.

Auto exposure (AE, Auto Exposure) adjusts the exposure time automatically until the desired target image data level (brightness) is reached. In normal cameras, the iris is always open and the light is always input. If you take a shot, reset the pre-input light, and then give the appropriate Integration Time to collect the light and output the image. If you give too much light, it will saturate and the screen will appear white. If you give too little light, it will come out dark. To prevent this phenomenon, the auto iris function of the camera is the automatic exposure function.

Auto White Balance (AWB) is the most important part of Auto Exposure. It is an algorithm that harmonizes the entire color by appropriately matching the Blue series color and the Red series color. Images reflected from an object are shifted in spectrum according to the color temperature. The human eye carries out automatic white balance for color temperature and recognizes white as white, but it does not appear white for photographs or images. For this reason, white balance function is activated. Basically, the Cb and Cr values are checked and controlled by the shifted value so as to be reduced to the original value.

Edge enhancement technology refers to a technique that sharpens the contour portion to compensate for the limited performance of the resolution that the lens can represent.

Basically, the cameras used in the AVM system can be set differently from ISPs of the first channel to the fourth channel. The reason for this is that the brightness input to the sensor differs depending on the camera, and accordingly, the sensitivity of the image is controlled differently. For example, referring back to FIG. 1, the right side (near CH200) in FIG. 1 indicates the direction of the sun, and the left side (near CH400) indicates the direction in which the shadow is formed. , And the right side can be set to be relatively low (dark).

FIG. 3 shows a block diagram 500 for an ISP (Image Signal Processor). In the present invention, the image of the AVM system is corrected by focusing on the AE 512 (Auto Expansion) and the AWB 513 (Auto White Balance) in the ISP operation. AE is associated with a first parameter, which is a parameter for brightness, and AWB is associated with a second parameter, which is a parameter for color.

Next, the concept of image correction area setting according to an embodiment of the present invention will be described with reference to FIG. 4 to FIG.

FIG. 4 is a view showing a concept of setting a lower region of each channel as a correction region, and FIG. 5 is a diagram showing a concept of setting a first correction region and a second correction region. 6 is a diagram illustrating selection of a front region of a vehicle as a target channel according to an embodiment of the present invention.

4, the image enhancement apparatus of the AVM system according to an embodiment of the present invention includes a correction region set by the first correction region setting unit 31 and the second correction region setting unit 32, And is a lower region of the image. In AVM, the camera is generally installed downward, and the user's display screen mainly displays the bottom surface (road surface) around the vehicle. Therefore, by restricting the correction area for parameter correction to the lower area of the channel, more accurate correction value application is possible. Although the shape of the lower region set as the correction region is shown as being rectangular in the drawing, it is not limited thereto. In some cases, a convex or concave correction region may be set or a curve region may be formed. It should be noted that the area set as the correction area is not also limited, and that the technical idea can be changed according to the setting within the same range.

On the other hand, the second correction region (CH121 or CH122) can be set by dividing the lower region of one channel. FIG. 5 is a diagram illustrating an example of a front area of a vehicle. Image information is input through a camera in a front area of the vehicle, and a floor, a horizon (H), and a parking line are displayed on the screen. The image information of the bottom surface including the parking line as shown in Fig. 5 can be obtained through the lower area serving as the correction area.

According to an embodiment of the present invention, the correction area set by the second correction area setting part 32 may be an area adjacent to the correction area set by the first correction area setting part. The method of setting the area will be described in detail with reference to FIG.

6, if the channel selection unit 20 selects the front region first channel CH100 as the target channel, the first correction region setting unit 31 sets the lower region of the first channel CH100 as the correction Area. When the first channel CH100 is selected as the target channel, the fourth channel CH400 and the second channel CH200 which are the left and right channels of the first channel CH100 are adjacent to each other. The controller 32 sets the correction area in the fourth channel CH400 and the second channel CH200. The second correction area setting unit 32 first sets the lower area of the fourth channel CH400 and the second channel CH200 and further corrects the lower right area CH422 of the lower area of the fourth channel CH400 Area. And the lower left area CH221 of the lower area of the second channel CH200 is set as the correction area. In the above embodiment, at the time of image correction of the front area (vehicle front), not only the parameters of the front area but also the parameters of the image of the left / right adjacent area are extracted and corrected, so that the AVM composite image can be outputted naturally .

In the same principle, if the right side region second channel CH200 is selected as the target channel by the channel selection unit 20, the first correction region setting unit 31 sets the lower region of the second channel CH200 as the correction region do. When the second channel CH200 is selected as the target channel, the first channel CH100 and the third channel CH300, which are the left and right channels of the second channel CH200, are adjacent to each other. Unit 32 sets a correction region in the first channel CH100 and the third channel CH300. The second correction area setting unit 32 first sets the lower areas of the first channel CH100 and the third channel CH300 and further sets the lower right area CH122 of the lower area of the first channel CH100 Area. And the left lower region CH321 of the lower region of the third channel CH300 is set as the correction region.

The above embodiments can be applied to analogy when the channel selection unit 20 targets the rear area third channel CH300 or when the left room fourth channel CH400 is targeted.

Referring back to FIG. 6, the target channel may reflect the lower region 100%, and the adjacent region of the target channel may reflect only the lower region 50%. At this time, in the case of the correction region setting (the correction region set by the second correction region setting unit) of the region adjacent to the target channel, it is not necessarily limited to 50%, and it may be set to be more than 0 It may be set to extract the parameter in the range of less than 100%. The correction region (second correction region) formed in the left / right channel of the target channel may be set symmetrically with respect to the target channel. For reference, the percentage referred to in the setting of the correction area may mean the area occupied on the screen when the obtained image information is output to the screen.

The correction area set by the second correction area setting part 32 may vary depending on the running time of the vehicle, the external environment depending on the weather, the driving mode, or the user definition. For example, if the vehicle is in a dark evening or at night, the correction area can be widened by more than 50%, and if the sun is bright during the daytime, the correction area can be reduced to less than 50%. In the case of rain, when the snow falls, the correction areas can be adjusted differently according to the clear weather, and the correction areas can be adjusted differently depending on whether the vehicle is in the driving mode or the parking mode.

In the method of setting the correction region (the region from which the parameter is extracted), if the specific boundary line is drawn and the parameters are extracted, the calculation process becomes complicated. However, after selecting the target channel as in the present invention, Adjusting the correction region (the region from which the parameter is extracted) through the correction region can simplify the calculation and provide a sufficiently reliable result value to be corrected.

The parameter extracting unit 40 extracts the parameter from the correction area set in accordance with the above-described embodiment, and a typical ISP can be used as a specific extracting method.

The extracted parameters are corrected through the parameter correcting unit 50. The correction method derives the average value by summing the parameters extracted from the correction region of the target channel and the parameters extracted from the correction region of the adjacent channel of the target channel. The derived (computed) average value is basically determined by the area ratio of the correction area in the summing of the parameters, not by deriving the average value by setting the first correction area and the second correction area at the same ratio, Depending on the composition ratio,

First, the area displayed on the screen is the same for each channel, and the upper areas (CH110, CH210, CH310, CH410) of the respective channels and the lower areas (CH120, CH220, CH320, CH420) One embodiment will be described under the assumption. Referring to FIG. 6, when the first channel CH100 becomes the target channel, the lower region CH120 of the first channel CH100 becomes the first correction region, and thus the lower region CH120 of the fourth channel CH400 And the left lower region CH221 of the second channel CH200 becomes the second correction region. Here, the area ratio of the lower region of the first channel CH100, the lower right region CH422 of the fourth channel and the lower left region CH221 of the second channel is 2: 1: 1. Depending on the area of the correction region, When the ratio of correction is determined, the ratio (expressed in%) of the parameters of each of the correction areas corresponding thereto becomes 50%: 25%: 25% in order.

For example, when the target channel is the first channel (CHlOO), the parameter for the brightness of the lower region (first correction region) of the first channel (CHlOO) is extracted by 140nit, and the right lower region (CH422) The parameter correction section 50 extracts the parameter for the brightness of the second channel CH200 from the luminance value of 140 * 0.5 + 80 * 0.25 + 220 * 0.25, and 145nit is obtained as an average value. This is applied to the first channel (CH100) as a target channel, and the parameter for brightness is corrected from 145nit to 140nit. This is a result of reflecting the influence of not only the target channel CH100 but also the surrounding channels CH200 and CH400.

When the target channel is the second channel CH200, the parameter for the brightness of the lower region (the first correction region) of the second channel CH100 is 210nit (the brightness for the entire lower region of the second channel, The second channel is extracted as a result value different from the brightness of the left lower region CH221), the parameter for the brightness of the right lower region CH122 of the first channel is extracted as 150nit, The parameter correcting unit 50 performs an operation of 210 * 0.5 + 150 * 0.25 + 75 * 0.25 to obtain 161.25 nit as an average value if the parameter for brightness of the left lower region CH321 of the CH300 is extracted by 75nit do. This is applied to the second channel (CH200), which is a target channel, to correct the brightness parameter from 210 nits to 161.25 nits.

If the above-described procedure is repeated using the third channel CH300 and the fourth channel CH400 of the vehicle as target channels, the brightness of each channel converges to a similar value as compared with the previous one. If this process is repeated a plurality of times, it is corrected to an image of almost the same brightness, so that the unnaturalness according to the brightness in the AVM composite image can be largely solved.

It is needless to say that the calculation process through the parameter correction unit 50 can be applied to the same parameter as the color.

In addition, according to an embodiment of the present invention, the parameter correcting unit 50 may assign a weight to the parameters extracted from the correction area set by the first correction area setting unit 31. In this case, the ratio at the time of parameter correction is not determined depending on the area of the correction area. For example, even if the ratio of the areas of the first correction area and the second correction area is 2: 1: 1, the ratio of the parameters of each correction area according to the weight is, for example, 80%: 10%: 10% Lt; / RTI >

In addition, parameter weights for each channel can be set differently. Only the first channel CH100 may be weighted or only the first channel CH100 and the second channel CH200 may be weighted and the remaining channels except for the third channel CH300 may be weighted Do. In this way, the brightness of the image of the AVM system can be actively adjusted based on the image information of the user's direction. For example, when a weight is assigned to a first channel (CH100) indicating a front region in a state in which a weight is not given to a parameter of another channel in a situation where the solution is floating in a front region around the vehicle, The entire AVM composite image will become darker if weights are given to the third channel CH300 indicating the rear area.

Lastly, according to an embodiment of the present invention, the channel selection unit 20 for selecting the target appropriately combines or selects all of the first channel (CHlOO) to the fourth channel (CH400) The whole can be improved.

According to the present invention, a target channel is selected, a correction region is set based on the target channel, and parameters are extracted and corrected in a correction region to improve an AVM composite image. Here, the parameter can be a parameter for the brightness and a parameter for the color.

As a result, in the image output through the AVM system, the sense of heterogeneity in the vicinity of the interface generated by the image synthesis can be reduced. In the present invention, not only the unnaturalness of the AVM interface but also the unnaturalness of the entire AVM screen And the parameters of brightness and color are simultaneously extracted as parameters for the correction and applied as a target of correction so that the quality of the outputted image can be remarkably improved.

Next, an image enhancement method of the AVM system according to an embodiment of the present invention will be described with reference to FIGS. 7 to 8. FIG. Herein, the contents overlapping with the image enhancement apparatus of the AVM system are omitted as much as possible.

7 is a block diagram illustrating an image enhancement method of an AVM system according to an embodiment of the present invention. 8 is a block diagram illustrating an image enhancement method of an AVM system according to another embodiment of the present invention.

Referring to FIG. 7, an image enhancement method of an AVM system according to an exemplary embodiment of the present invention includes (a) acquiring image information of a first channel to a fourth channel from a plurality of cameras installed in a vehicle, ); (b) a channel selection step (S720) of selecting any one of the first to fourth channels; (c) a first correction area setting step (S730) of setting a correction area in the selected channel; (d) a second correction area setting step (S740) of setting a correction area in a channel adjacent to the selected channel; (e) a parameter extracting step (S750) of extracting a parameter from the set correction area; (f) a parameter correction step (S760) of correcting the extracted parameter; (S770) for outputting the corrected AVM composite image by reflecting the corrected parameter, wherein the parameter correction step comprises the steps of (f-1) extracting the first and second correction areas (F-2) an input step of applying an average value of the parameters to the selected channel.

The correction region set in the (c) first correction region setting step and (d) the second correction region setting step may be a lower region of the channel image,

The correction area set in the second correction area setting step (d) may be an area adjacent to the correction area set in the (c) first correction area setting step.

Further, in the second correction region setting step (d), the range of the second correction object area may be variable according to time, an external environment depending on weather, a driving mode, or a user definition.

8, the method may further include a weighting step of weighting the parameters extracted from the correction area set in the step (c) of setting the first correction area after the step (e) of extracting the parameter .

The above process may be continuously performed in the process of outputting the image, and may be performed once per predetermined frame output on the screen.

The AVM system image enhancement method of the present invention immediately corrects the image information obtained from the camera and then outputs the synthesized image to the AVM composite image so that the image synthesized by the AVM related arts, Unlike "extracting and extracting extraction factors from the synthesized image", it is possible to drastically reduce the calculation process because "after the parameter correction, the image with the corrected parameter is synthesized".

In addition, since the parameters extracted in the (e) parameter extraction step can include the first parameter for the brightness of the correction region and the second parameter for the color of the correction region, A composite image can be provided.

Since the configuration necessary for explaining each step can be inferred from the above-described automatic opening and closing system, redundant description will be omitted.

It should be noted that the above steps are preferably performed in the order of the reference numerals, but are not limited thereto. For example, the first correction subject region setting step S730 and the second correction subject region setting step S740 may be performed substantially simultaneously.

In the foregoing detailed description of the present invention, only specific embodiments thereof have been described. It is to be understood, however, that the invention is not to be limited to the specific forms thereof, which come within the scope of the appended claims, and all variations, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims Should be understood.

1: vehicle
10: Image information acquisition unit
20: Channel selector
30: correction area setting unit
31: First correction area setting section
32: second correction area setting unit
40:
50:
60: Video output unit
100, 200, 300, 400: camera
500: ISP
510: Invention Image Process
CH100, CH200, CH300, CH400: first channel, second channel, third channel, fourth channel

Claims (12)

A camera for photographing the first channel image, a camera for photographing the second channel image, a camera for photographing the third channel image, and a camera for photographing the fourth channel image;
An image information acquiring unit acquiring image information of the first channel to the fourth channel;
A channel selector for selecting one of the first to fourth channels;
A first correction area setting unit for setting a correction area in the selected channel;
A second correction area setting unit for setting a correction area in a channel adjacent to the selected channel;
A parameter extracting unit for extracting a parameter from the image information of the correction area set by the first correction area setting unit and the second correction area setting unit;
A parameter correcting unit for correcting the extracted parameter; And
And an image output unit for outputting the corrected AVM composite image by reflecting the corrected parameter,
Wherein the parameter correction unit calculates an average value of the parameters extracted in the first correction area and the second correction area and applies the parameter to the parameters of the selected channel to improve the AVM composite image.
The method according to claim 1,
Wherein the parameter extracted by the parameter extracting unit includes:
A first parameter for the brightness of the correction region, and a second parameter for the color of the correction region.
The method according to claim 1,
Wherein the correction area set by the first correction area setting part and the second correction area setting part is a lower area of the channel image.
The method of claim 3,
Wherein the correction area set by the second correction area setting unit comprises:
Wherein the first correction area setting unit is an area adjacent to the correction area set by the first correction area setting unit.
5. The method of claim 4,
Wherein the correction area set by the second correction area setting unit comprises:
Wherein the AVM interface is variable according to time, an external environment according to weather, a driving mode, or a user definition.
The method according to claim 1,
Wherein the parameter correcting unit comprises:
Wherein the first correction region setting unit assigns a weight to the parameters extracted from the correction region set by the first correction region setting unit.
(a) acquiring image information of a first channel to a fourth channel from a plurality of cameras installed in a vehicle;
(b) a channel selecting step of selecting any one of the first to fourth channels;
(c) a first correction region setting step of setting a correction region in the selected channel;
(d) a second correction region setting step of setting a correction region in a channel adjacent to the selected channel;
(e) a parameter extracting step of extracting a parameter from the set correction area;
(f) a parameter correction step of correcting the extracted parameter;
(g) outputting the corrected AVM composite image by reflecting the corrected parameter,
The (f) parameter correction step
(f-1) calculating an average value of the parameters extracted in the first correction area and the second correction area;
and (f-2) applying an average value of the parameters to the selected channel.
8. The method of claim 7,
The parameters extracted in the parameter extraction step (e)
A first parameter for the brightness of the correction region, and a second parameter for the color of the correction region.
8. The method of claim 7,
Wherein the correction area set in the first correction area setting step (c) and the second correction area setting step (d) is a lower area of the channel image.
10. The method of claim 9,
The correction area set in the second correction area setting step (d)
(C) an area adjacent to the correction area set in the first correction area setting step.
8. The method of claim 7,
In the (d) second correction region setting step,
Wherein the range of the second correction region is variable according to time, an external environment according to weather, a driving mode, or a user definition.
8. The method of claim 7,
After the step (e) of extracting the parameters,
Further comprising a weighting step of weighting the parameters extracted from the correction area set in the step (c) of setting the first correction area.

Images