KR101847825B1 - Around View System and Method for Camera Brightness Correction thereof - Google Patents

Abstract

The present invention discloses an arousal view system and a camera image brightness correction method thereof. An audiovisual system according to an aspect of the present invention includes: an image receiving unit, which is provided for each of front, rear, left and right sides of a vehicle, for receiving a front image, a rear image, a left image and a right image from a plurality of cameras; Wherein the controller calculates a correction reference value for matching the brightness of the front image, the rear image, the left image, and the right image equally, and adjusts the brightness of the front image, the rear image, the left image, A correction value calculation unit for calculating a front correction value, a rear correction value, a left side room correction value and a right side correction value for correcting each of them in accordance with the correction reference value; A brightness correcting unit for correcting a correction value corresponding to the at least one lamp among the forward correction value and the backward correction value by applying at least one predetermined weight to the at least one lamp of the front lamp and the rear lamp, And correcting the at least one lamp by using the front correction value, the rear correction value, the left side room correction value and the right side room correction value, and when the at least one lamp is turned on, And an image synthesizing unit for synthesizing the front image, the front image, and the rear image into an Around View screen after performing brightness correction.

Description

[0001] The present invention relates to an Around view system and a camera image brightness correction method thereof,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to an ambient view system, and more particularly, to an ambient view system capable of uniformly correcting brightness of front, rear, left, and right images.

In general, the Around View System includes a plurality of cameras on the front, rear, left and right sides of the vehicle, and displays the front, rear, left, and right images on a single screen, centering on the vehicle top view image.

The camera adjusts the brightness of the captured image automatically considering the surrounding brightness. The AroundView system adjusts the brightness of the front, back, left, and right images composed of one screen similarly regardless of whether the brightness of the camera is adjusted or not, .

Therefore, in the conventional surround-view system, there is a problem in that the sense of heterogeneity of the corrected image becomes worse due to the influence of the front lamp or the rear lamp when the night lamp is turned on.

SUMMARY OF THE INVENTION The present invention has been made in view of the technical background as described above, and it is an object of the present invention to provide a method and apparatus for verifying whether a front lamp and a rear lamp are lit or not and to reduce a degree of brightness correction for an image corresponding to a lamp, View system and a camera image brightness correction method thereof.

An audiovisual system according to an aspect of the present invention includes: an image receiving unit, which is provided for each of front, rear, left and right sides of a vehicle, for receiving a front image, a rear image, a left image and a right image from a plurality of cameras; Wherein the controller calculates a correction reference value for matching the brightness of the front image, the rear image, the left image, and the right image equally, and adjusts the brightness of the front image, the rear image, the left image, A correction value calculation unit for calculating a front correction value, a rear correction value, a left side room correction value and a right side correction value for correcting each of them in accordance with the correction reference value; A brightness correcting unit for correcting a correction value corresponding to the at least one lamp among the forward correction value and the backward correction value by applying at least one predetermined weight to the at least one lamp of the front lamp and the rear lamp, And correcting the at least one lamp by using the front correction value, the rear correction value, the left side room correction value and the right side room correction value, and when the at least one lamp is turned on, And an image synthesizing unit for synthesizing the front image, the front image, and the rear image into an Around View screen after performing brightness correction.

According to another aspect of the present invention, there is provided a method for correcting a camera image brightness of an averaged view system, the method comprising: receiving a front image, a rear image, a left image, and a right image from a plurality of cameras, Calculating a correction reference value for adjusting the brightness of the image and the right-eye image to be the same; Calculating a forward correction value, a backward correction value, a left side motion correction value, and a right side motion correction value for adjusting the brightness of the forward image, the backward image, the left image, and the right image to the correction reference value, respectively; Confirming whether the front lamp and the rear lamp are turned on; Calculating a first weight value exceeding 0 and less than 1, which is preset to the forward correction value, and re-valuing the forward correction value when the front lamp is turned on; Calculating a second weight value exceeding 0 and less than 1, which is set in advance to the rear correction value, and re-calculating the rear correction value when the rear lamp is turned on; The left and right side correction values and the right side correction value are respectively applied to correct the brightness of the left side image and the right side image, and the brightness of the left side image and the right side image are corrected by using the forward correction value and the backward correction value, Correcting the brightness of the forward image and the backward image using the brightness information; And configuring the front image, the rear image, the left image, and the right image, which are brightness-corrected, as one surrounding view image in the correcting step.

According to the present invention, not only the brightness disparity of the surround view image can be solved by the brightness correction, but also when at least one of the front lamp and the rear lamp is turned on, It is possible to prevent a problem that adverse effect is exerted on the brightness correction of the other images (the left side image, the rear side image, the front image corresponding to the unlit lamp, and the rear image) due to the lamp.

In addition, according to the present invention, since the image corresponding to the lamp illuminated in the surround view screen is relatively brightly displayed, it is possible to express whether or not the lamp is turned on in the illusion view screen, thereby providing an improved user interface.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a configuration diagram showing an overview system according to an embodiment of the present invention; FIG.
2 is a flowchart illustrating a camera image brightness correction method according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. As used herein, the terms " comprises, " and / or "comprising" refer to the presence or absence of one or more other components, steps, operations, and / Or additions.

Embodiments of the present invention will now be described in detail with reference to the accompanying drawings. FIG. 1 is a configuration diagram illustrating an overview system according to an embodiment of the present invention.

1, an overview system 10 according to an embodiment of the present invention includes an image receiving unit 110, a correction value calculating unit 120, a brightness adjusting unit 130, a lookup table 140, A display 150, and a display 160.

The image receiving unit 110 receives a front image, a rear image, a left image, and a right image from a plurality of cameras provided on the front, rear, left, and right sides of the vehicle. At this time, the image receiving unit 110 can receive each image from a plurality of cameras through MOST (Media Oriented Systems Transport), LIN (Local Interconnect Network), CAN (Controller Area Network), Ethernet, . Here, the plurality of cameras may not perform the brightness correction for the photographed image by itself.

The correction value calculating unit 120 checks the brightness of the front image, the rear image, the left image, and the right image, and calculates a correction reference value for uniformly adjusting the brightness of the front, rear, left, and right images. Here, the correction value calculating unit 120 may determine a value obtained by averaging the brightness of the front, back, left, and right images as the correction reference value

The correction value calculating unit 120 calculates a forward correction value, a backward correction value, a left-side correction value, and a right-side correction value, which correct the brightness of the front image, the rear image, the left image, and the right image according to the correction reference values, respectively.

For example, when the brightnesses of the front image, the rear image, the left image, and the right image are 120, 80, 90, and 110, respectively, the correction value calculator 120 averages these values to determine a correction reference value of 100 , The front correction value, the rear correction value, the left side correction value and the right side correction value to match the brightness of each image to the correction reference value by subtracting the brightness of each image from the correction reference value 100 to -20, +20, +10, and -10 Can be calculated.

However, when the front lamp or the rear lamp is turned on, excessive red color enters the front image or the rear image corresponding to the illuminated lamp. At this time, if the brightness of the front image or the rear image corresponding to the illuminated lamp is corrected by adjusting to the correction reference value, a problem of adversely affecting the brightness correction of the other images (the left image, the right image, etc.) occurs. In order to prevent this, it is necessary to reduce the degree of brightness correction of the image corresponding to the illuminated lamp. To this end, the brightness correction unit 130 redefines the brightness correction value of the image corresponding to the illuminated lamp.

The brightness correction unit 130 determines whether at least one of the front lamp and the rear lamp is turned on. At this time, when at least one of the first lighting signal for instructing lighting of the front lamp and the second lighting signal for lighting the rear lamp is applied, the brightness corrector 130 turns on at least one lamp corresponding thereto Can be confirmed.

When at least one lamp is turned on, the brightness correction unit 130 multiplies the correction reference value by at least one predetermined weight? To redefine the brightness correction value of the image corresponding to at least one lamp. Here, the weight is greater than 0 and smaller than 1, and can be determined experimentally in consideration of the brightness of the front lamp and the rear lamp in the image captured by the front camera and the rear camera.

Specifically, when the front lamp is turned on, the brightness correction unit 130 computes a first weight to a pre-calculated forward correction value to redefine a forward correction value. When the rear lamp is turned on, a second weight And rear correction values are calculated. At this time, the first and second weights may be the same. Accordingly, the brightness correction unit 130 can lessen (adjust) the brightness of the image corresponding to the illuminated lamp, and can improve the reddening phenomenon when the other image is composed of the screen due to the lamp.

The lookup table 140 stores information about the correspondence between point units of the world coordinate system and pixel units of the display screen. At this time, the corresponding relationship is the correspondence between the ground plane and the plane of the display image, assuming that the ground is flat. Here, the corresponding relationship may be a non-linear relationship due to the distortion of the camera lens.

The image synthesizer 150 composes an Around View according to the synthesis of the left side image, the right side image, the front image, and the back image using the information on the correspondence relationship stored in the lookup table 140 do.

Here, the image synthesizing unit 150 applies the left-side room correction value, the right-side room correction value, the forward correction value, and the backward correction value. If there is a pre-corrected forward correction value or a backward correction value, The image, the forward image, and the backward image are corrected for brightness, and then configured as one surrounding view screen.

The display 160 displays the surround view screen configured by the image combining unit 150.

As described above, according to the present invention, the brightness of front, rear, left and right images can be corrected only by the surround-view system 10 without correcting the brightness of front, rear, left and right images separately by the camera, The correction may not be performed.

Hereinafter, a camera image brightness correction method according to an embodiment of the present invention will be described with reference to FIG. 2 is a flowchart illustrating a camera image brightness correction method according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the surround view system 10 determines whether a front image, a rear image, a left image, and a right image are received from a plurality of cameras (S210).

The surround view system 10 checks the brightness of the received forward image, rearward image, leftward image, and rightward image, and calculates a forward correction value, a backward correction value, a leftward correction value, and a leftward correction value for uniformly adjusting the brightness of the front, And the right side correction values are calculated (S220). Here, the surround-view system 10 can calculate the forward correction value, the backward correction value, the left-side correction value, and the right-side correction value by subtracting the correction reference value obtained by averaging the brightness of the front, rear, left, and right images from the brightness of the front,

Next, the surround view system 10 confirms whether the front lamp and the rear lamp are turned on (S230). At this time, the surround-view system 10 confirms that the front lamp and the rear lamp are turned on when a first lighting signal for instructing lighting of the front lamp and a second lighting signal for lighting the rear lamp are applied.

When the front lamp is turned on, the surrounding view system 10 multiplies the pre-calculated forward correction value by a first weighting value of more than 0 and less than 1, and reorders the forward correction value (S240).

When the rear lamp is turned on, the surrounding view system 10 computes a second weight that is greater than 0 and less than 1, which is preset to the pre-calculated rear correction value, and reorders the rear correction value (S250). Here, the first and second weights can be determined experimentally.

The surround view system 10 corrects the brightness of the left and right images by applying the left and right backward correction values respectively and then calculates the brightness of the forward and backward images using the pre- The brightness of the backward image is corrected (S260).

Specifically, when the front lamp is turned on, the surround-view system 10 corrects the brightness of the forward image using the pre-determined forward correction value, and adjusts the brightness of the backward image using the rear- . In other cases, the brightness of the forward and backward images is corrected using the pre-calculated forward correction value and the backward correction value.

The surround view system 10 constructs a front view image, a rear view image, a left view image, and a right view image, each of which is brightness-corrected, by using each brightness correction value, as one surrounding view screen (S270).

As described above, according to the present invention, the brightness of each image is corrected to eliminate the brightness disparity of the surround view image, and when at least one of the front lamp and the rear lamp is lit, the degree of brightness correction The red light is increased in the image due to the turned-on lamp, thereby preventing the problem of adversely affecting the brightness correction of the other images.

In addition, according to the present invention, since the image corresponding to the lamp illuminated in the surround view screen is relatively brightly displayed, it is possible to express whether or not the lamp is turned on in the illusion view screen, thereby providing an improved user interface.

While the present invention has been described in detail with reference to the accompanying drawings, it is to be understood that the invention is not limited to the above-described embodiments. Those skilled in the art will appreciate that various modifications, Of course, this is possible. Accordingly, the scope of protection of the present invention should not be limited to the above-described embodiments, but should be determined by the description of the following claims.

Claims (5)

A video image receiving unit for receiving a front image, a rear image, a left image, and a right image from each of a plurality of cameras,
Wherein the controller calculates a correction reference value for matching the brightness of the front image, the rear image, the left image, and the right image equally, and adjusts the brightness of the front image, the rear image, the left image, A correction value calculation unit for calculating a front correction value, a rear correction value, a left side room correction value and a right side correction value for correcting each of them in accordance with the correction reference value;
A brightness correcting unit for correcting a correction value corresponding to the at least one lamp among the forward correction value and the backward correction value by applying at least one predetermined weight to the at least one lamp of the front lamp and the rear lamp, And
Wherein the at least one lamp is turned on by using the forward correction value, the backward correction value, the left side room correction value, and the right side room correction value, An image combining unit configured to perform brightness correction on the image, the forward image, and the backward image, and to form an Around View screen,
. ≪ / RTI > The apparatus of claim 1,
The front correction value is calculated by multiplying the forward correction value calculated by the correction value calculation unit by a first weight value larger than 0 and smaller than 1 by considering the brightness of the front lamp, Wherein the rear correction value is calculated by multiplying the rear correction value calculated by the correction value calculation unit by a second weight value larger than 0 and smaller than 1 in consideration of the brightness of the rear lamp. The controller calculates a correction reference value for matching the brightness of the front image, the rear image, the left image, and the right image when the front image, the rear image, the left image, and the right image are received from the plurality of cameras step;
Calculating a forward correction value, a backward correction value, a left side motion correction value, and a right side motion correction value for adjusting the brightness of the forward image, the backward image, the left image, and the right image to the correction reference value, respectively;
Confirming whether the front lamp and the rear lamp are turned on;
Calculating a first weight value exceeding 0 and less than 1, which is preset to the forward correction value, and re-valuing the forward correction value when the front lamp is turned on;
Calculating a second weight value exceeding 0 and less than 1, which is set in advance to the rear correction value, and re-calculating the rear correction value when the rear lamp is turned on;
The left and right side correction values and the right side correction value are respectively applied to correct the brightness of the left side image and the right side image, and the brightness of the left side image and the right side image are corrected by using the forward correction value and the backward correction value, Correcting the brightness of the forward image and the backward image using the brightness information; And
The step of correcting the brightness of the front image, the rear image, the left image, and the right image,
A camera image brightness correction method of the surrounding view system. 4. The apparatus of claim 3, wherein the first and second weights are:
Wherein the brightness of the front and rear lamps taken by the front camera for photographing the forward image and the back camera for photographing the rear image is determined by experiments. 4. The method of claim 3,
A step of checking whether a first lighting signal instructing lighting of the front lamp and a second lighting signal instructing lighting of the rear lamp are applied
The camera image brightness correction method comprising:

Images