KR101774691B1 - System for correcting flicker - Google Patents

Abstract

The present invention relates to a flicker correction system which corrects an image by removing flicker and displays the corrected image when flicker is detected in the image captured by a camera to provide an image identical to that seen with the unaided eyes of a driver. According to the present invention, the flicker correction system includes: an image capturing unit which is installed on a vehicle to output images capturing the surroundings of the vehicle; a flicker detection unit which analyzes the images being output from the image capturing unit to detect at least one of flicker due to a change in the brightness and flicker due to a flicker generation object; and a flicker compensation unit which executes a correction operation to remove flicker from the image when flicker is detected in the image by the flicker detection unit. The present invention can correct an image and display the corrected image by removing flicker therefrom when flicker is detected in the image captured by a camera to provide an image identical to that seen with the unaided eyes of a driver, enable the driver to see an image that is identical to the result recognized with his/her unaided eyes, enable the driver to feel comfortable, and reduce eye fatigue on the drivers end.

Description

SYSTEM FOR CORRECTING FLICKER [0001]

The present invention relates to a flicker correction system, and more particularly, to a flicker correction system, and more particularly, to a flicker correction system in which when a flicker is detected in a photographed image, So as to provide the same image as that the driver sees as a naked eye.

Generally, the vehicle is equipped with a side mirror and a room mirror so that the driver can grasp the left, right or rear side road conditions of the driving lane while driving.

The side mirrors are attached to both sides of the vehicle body and recognize the driving direction and speed of the other vehicle traveling from the rear while the driver is watching the front side and the left and right sides while the vehicle is in operation so as to safely change the lane, And the room mirror can also be used for various kinds of safety operations, such as detecting the rear situation of the vehicle when the vehicle is running, backward or backward parking, etc. Perform required functions.

In recent years, in order to provide accuracy and convenience to users, a display device is mounted on a room mirror, various display devices such as a navigation system, a head-up display (HUD), and a cluster A camera monitor system (CMS) technology has been developed to enable a driver to easily monitor a rear image captured by a rear surveillance camera installed in the vehicle, even in a vehicle.

A rear monitor camera is installed in a vehicle such as a display room mirror disclosed in Korean Registered Utility Model No. 20-0264726 (name of a design: a rearview mirror equipped with a monitor), so that a video image The monitor is installed in the room mirror so that it can accurately grasp the situation of backward and backward parking.

In addition, Korean Patent Laid-Open Publication No. 10-2014-0039820 (entitled "DISPLAY ROOM MIRROR SYSTEM") is provided with a camera module for photographing the left and right rear sides of the vehicle and a display module for outputting images photographed by the camera module A display room mirror system is disclosed.

On the other hand, a vehicle light including a headlight for a vehicle is mainly used for driving a current continuously and controlling a headlight driving method using a PWM (Pulse Width Modulation) method. In the case of a light using an LED, And the efficiency of the PWM method is excellent.

However, in the case where the light using the PWM method is photographed by the camera in the flicker correction system and displayed on the monitor, the ON / OFF control cycle of the light illumination and the image sampling period of the camera are independent of each other, A phenomenon occurs.

A phenomenon in which unintended signal distortion occurs due to the sampling of such a signal is called aliasing.

The aliasing is a signal distortion phenomenon in which the sampling frequency of the analog signal is smaller than twice the maximum frequency of the signal or the filtering is inadequate to cause adjacent spectra to overlap each other. As shown in FIG. 1, when the input signal is sampled, According to Strhenan's theorem, the minimum sampling frequency fs should be at least twice the highest effective frequency W included in the signal.

However, when sampling at a frequency of 2W or less, the spectrum of the sampled signal is superimposed on the spectrum of the input signal so that the ghost is superimposed on the spectrum of the input signal, so that superposition of the frequencies is generated so that the wing of the fan slowly rotates or vice versa The frequency is inadequate.

FIG. 2 is a waveform chart showing the inconsistency between the on / off cycle of the light and the photographing cycle of the camera. When the on / off cycle of the light and the photographing sampling cycle of the camera for photographing the image are compared, And the image sampling period of the camera are independent from each other, a position where the light on point and a camera shooting period coincide with each other and an inconsistent position occur.

Such blinking images cause different distinctions from what the driver recognizes in me, and have the problem of distracting the driver due to fatigue in the eyes of the driver, or blinking of images that are more than necessary.

Korean Registered Utility Model No. 20-0264726 (Name of Design: Rearview Mirror with Monitor) Korean Patent Laid-Open No. 10-2014-0039820 (entitled DISPLAY ROOM MIRROR SYSTEM)

In order to solve such a problem, the present invention is characterized in that when a flicker is detected in a photographed image, the cycle of on / off of illumination of the vehicle and the surroundings of the vehicle is independent from the sampling period of the image, And to provide a flicker correction system capable of providing the same image as a naked eye.

According to an aspect of the present invention, there is provided a flicker correction system comprising: an image photographing unit installed in a vehicle and outputting an image of the surroundings of the vehicle; A blink detection unit for detecting at least one of a blinking object and a flicker due to a change in brightness by analyzing an image output from the image photographing unit; And a flicker correction unit for correcting the detected flicker to be removed from the image when flicker is detected in the flicker detection unit.

The flicker correction system according to the present invention may further include a display unit for outputting the corrected image by removing flicker from the image output from the image capturing unit or the flicker correction unit.

The flicker detecting unit may detect an object or a predetermined region included in the image through the image processing program stored in advance and output the brightness value of the detected object or the predetermined region An image analyzer for detecting brightness information including the brightness information; And a flicker analyzing unit for analyzing the brightness information detected by the image analyzing unit to detect an object or a predetermined area where flickering occurs and analyzing a flickering period due to a change in brightness in the detected object or a predetermined area, And the like.

In addition, the flicker analyzing unit according to the present invention compares the detected object with at least one shape of a head lamp, a fog lamp, a brake light, a tail light, a turn signal lamp, a traffic light, .

The flicker analyzing unit according to the present invention is characterized in that when a specific on / off cycle is detected in a predetermined shape in a predetermined area of a predetermined image area, the flicker analyzer determines the object to be corrected.

In addition, the flicker analyzing unit according to the present invention may be configured such that when a plurality of objects to be corrected are detected, they are located within a certain range from the center of the image, occupy an area over a predetermined area on the image, or are flicker- Is set as the representative correction target lamp.

In addition, the flicker analyzing unit according to the present invention is characterized in that the flicker period is detected for each image area in which flicker is detected on the image.

In addition, the flicker analyzing unit according to the present invention compares the flicker period with a previously stored reference value for flicker correction judgment, and sets the flicker period as a correction target or excludes the correction target according to the result.

Also, the flicker analyzing unit according to the present invention finds a flicker object included in the image, identifies a type according to the lamp shape, compares the flicker target lamp with the previously stored lamp to determine whether a matching lamp exists, The flashing period of the lamp to be detected is searched for by the type of the stored lamp, and the blinking period of the blinking target lamp is compared with the searched period. If the blinking period is a similar period, Is not included in the blinker correction target, and if not, it is determined that the blinker is to be corrected.

In addition, the flicker analyzing unit according to the present invention analyzes the flicker cycle, and when the cycle is displayed in one cycle, it captures the image again by changing the capture cycle of the image, and analyzes the cycle to analyze the image before the capture cycle is adjusted And if it is displayed in one cycle in the same manner as the capturing cycle, it is determined that the flicker is a flicker that can be confirmed inside and is excluded from the flicker correction target.

In addition, the flicker analyzing unit according to the present invention determines aliasing phenomenon occurring in relation to the sampling period of the camera when the flicker cycle is changed after changing the image capturing cycle to determine that the flicker is to be corrected .

The flicker correction unit may further include a photographing period correction unit that outputs a photographing period correction signal so that the flicker is corrected using the flicker period detected by the flicker detection unit.

Further, the photographing cycle according to the present invention may be performed by adjusting the photographing start time or adjusting the photographing interval so that the detected flickering period is included in the cycle of capturing the image, or adjusting the photographing start time and photographing interval together .

In addition, the corrected phototaking period according to the present invention may be such that the flicker is corrected based on either the flicker period detected on the image or the Persistence of Vision period during which the image is held for a period of time after disappearing in the driver ' .

The flicker compensator according to the present invention includes a brightness corrector for correcting flicker by correcting the brightness of the flickering region of the image with a preset brightness value or a brightness value determined by image analysis.

In addition, the flicker correction system according to the present invention is installed in an image sensor of a camera, an image processor for an image processing (ISP), a controller receiving a camera image, and a display device.

The present invention is advantageous in that when a flicker is detected in an image taken by a camera, the flicker is corrected and displayed by removing the flicker, thereby providing the same image as that the driver sees as a naked eye.

In addition, the present invention has the advantage of providing a sense of stability by feeling the same feeling as the result recognized by the driver, and reducing the fatigue of the driver's eyes.

1 is a waveform diagram showing frequency overlap due to aliasing;
Fig. 2 is a waveform diagram showing a mismatch between the on / off cycle of the light and the photographing cycle of the camera. Fig.
3 is a block diagram illustrating a configuration of a flicker correction system according to the present invention;
4 is a block diagram illustrating a flicker detector configuration of the flicker correction system according to FIG.
Figure 5 is a block diagram of a flicker correction configuration of the flicker correction system according to Figure 3;
FIG. 6 is a waveform diagram in which the sampling period is adjusted so as to be taken without flicker in the flicker correction system according to FIG. 3 in the input and sampling state of FIG. 2;
7 is a flowchart illustrating a method of controlling a flicker correction system according to the present invention.
FIG. 8 is a flowchart illustrating a correction process according to flicker in the flicker correction system according to FIG. 7. FIG.
9 is a flowchart illustrating a process of determining a correction target of the flicker correction system according to FIG.
FIG. 10 is a flowchart illustrating a process of adjusting a photographing cycle in the process of determining a correction object according to FIG.

Hereinafter, preferred embodiments of a flicker correction system according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 3 is a block diagram showing the configuration of a flicker correction system according to the present invention, FIG. 4 is a block diagram showing a configuration of a flicker detection unit of the flicker correction system according to FIG. 3, and FIG. 5 is a block diagram of a flicker correction system according to FIG. And FIG.

3 to 5, the flicker correction system 100 according to the present invention includes an image photographing unit 110 installed in a vehicle and outputting an image of the surroundings of the vehicle, A flicker detecting unit 120 for detecting at least one of a blinking object and a flicker due to a change in brightness by analyzing an output image; and a flicker detecting unit 120 for detecting flicker in the flicker detecting unit 120, And a display unit 140 for outputting an image output from the image capturing unit 110 or an image corrected by the flicker correction unit 130. The flicker correction unit 130 may include a flicker correction unit 130,

The image capturing unit 110 includes at least one image capturing unit 110 and a flicker detecting unit 120. The image capturing unit 110 captures an image of the surroundings of the vehicle such as the front, Various photoelectric conversion sensors can be used.

In addition, the image photographing unit 110 may additionally include an infrared camera equipped with an infrared ray sensor or an infrared ray filter so as to be able to photograph not only a visible light region but also a night image.

The flicker detector 120 receives and analyzes the image output from the image capturing unit 110 and detects flicker due to changes in object, area, and brightness in which the flicker occurs in the received image, An image analyzer 121, and a flicker analyzer 122.

The image analyzer 121 receives the image output from the image capturing unit 110 and analyzes an object or a predetermined region included in the image through a previously stored image processing program, Detects an object or a predetermined area, and detects brightness information including the brightness of the light and the color of the light in the detected object or a certain area.

In addition, the image analyzer 121 analyzes an interest image region including an interest image region including a certain range from the entire image region or the center position of the image, or an arbitrary position on the image.

The flicker analyzing unit 122 analyzes the brightness information detected by the image analyzing unit 121 to determine whether the flicker occurs in an object or a certain region (for example, a width of a predetermined size from the center of the image to the upper / lower / left / (E.g., a strip-shaped area having a rectangular shape, a rectangular area having a rectangular shape, or a rectangular area having a predetermined number of pixels), a flickering period is detected for each of the entire image or the image area in which flicker is detected, And calculates a brightness change due to the flicker, and detects whether the brightness change is a flicker caused by the lamp.

That is, the flicker analyzing unit 122 may include a flicker analyzing unit 122 for detecting the shape of the object detected by the image analyzing unit 121 in order to recognize the lamp including a lamp installed in the vehicle and a lamp not installed in the vehicle, The object of flicker correction is compared with the shape of a head lamp, a fog light, a brake light, a tail light, a turn signal lamp, a traffic light, a road light or a street light.

The flicker analyzer 122 recognizes the vehicle shape from the shape of the object detected by the image analyzer 121 and analyzes the position of the lamp installed in the vehicle from the recognized shape of the vehicle, A brake light, a tail light, and a turn signal lamp.

The flicker analyzing unit 122 analyzes the position and shape of the lamp installed in the vehicle to distinguish the head lamp, the fog lamp, the brake light, the tail lamp, the turn signal lamp, and the periodic flicker or urgency of the turn signal lamp Allowing the periodic flicker of the turn signal light to indicate the situation to be detected.

In addition, the flicker analyzing unit 122 may compare the flicker period according to the brightness change analyzed in the image with the flicker period of the stored lamp, and recognize the flicker period as a flicker correction target lamp.

In recent years, most automotive lamps consist of head lamps, fog lights, brake lights and turn signals using LED as a light source. Most of them are operated by PWM (Pulse Width Modulation) control method. The periodic change in brightness is detected by PWM control on the photographed image by using the image capturing unit 110, and the brightness of the lamp is detected by the lamp Flicker occurs.

When a plurality of lamps, for example, a head lamp, a fog lamp, and a signal lamp, having a blinking target to be corrected, are detected from the brightness information detected by the image analyzer 121, the flicker analyzer 122 calculates a constant Object or an object detected in a region over a certain range on the image may be set as a representative object to be corrected and a flicker cycle according to a change in brightness of the set representative object to be corrected may be detected.

Also, the flicker analyzer 122 may compare the flicker cycle with a previously stored flicker correction reference value, and adjust the flicker cycle according to the result to set an object that is easy to flicker as a representative object.

In addition, the flicker analyzer 122 compares the flicker cycle with a previously stored reference value for flicker correction determination, and sets the flicker cycle as a correction target or excludes it from the correction target.

That is, the flicker correction determination period is checked to see if it is turned on by PWM control, direction indication, or emergency state, so that the flicker correction is excluded from periodic lighting according to the direction or emergency.

The lighting by PWM control is controlled by periodic control. However, it can be seen that it is always lighted in the eyes of the person, and periodic lighting according to the direction instruction or emergency situation can be distinguished by light / So it is not necessary to correct the flicker due to the direction instruction or the emergency situation on the displayed screen.

In addition, the flicker analyzer 122 may use an LED as a light source such as a traffic light, a road light, or a street light in a predetermined image area of interest, It is determined as a target.

In addition, the flicker analyzer 122 finds a flicker object included in the image, identifies a type according to the lamp shape, compares the flicker target lamp with the previously stored lamp to determine whether there is a matching lamp, The flashing period of the blinking target lamp is compared with the searched period. If the blinking period of the blinking target lamp is shorter than the blinking period of the blinking target lamp, Is excluded from the blinker correction target, and if not, it is determined that the blinker is to be corrected.

In addition, the flicker analyzing unit 122 analyzes the flicker cycle, and when the cycle is displayed in one cycle, captures an image by changing the capture cycle of the image, analyzes the cycle of the captured image, If it is displayed in the same cycle as the image capturing cycle before adjusting the cycle, it is judged as blinking which can be confirmed inside and it is excluded from the blink compensation.

When the flicker cycle is changed after changing the capture period of the image, the flicker analyzer 122 determines that the high frequency flicker is an aliasing phenomenon occurring in relation to the sampling period of the camera, .

In addition, if the periodic analysis result is not expressed by a finite number of periodic combinations, the flicker analyzer 122 determines that the flicker is due to an irregular natural phenomenon, and excludes the flicker from the flicker correction target.

The flicker correction unit 130 is configured to correct the detected flicker to be removed from the image when a flicker is detected in the flicker detection unit 120. The flicker correction unit 130 includes a shooting period correction unit 131 and a brightness correction unit 132 .

When the flicker period is detected according to the brightness change, the photographing period correction unit 131 adjusts the flicker period so as to be included in the photographing period of the image photographing unit 110 according to the detected flicker period so as to provide a smoother and more comfortable image to the driver. The image pickup unit 110 generates the image pickup period adjustment signal and outputs the image pickup period adjustment signal to the image pickup unit 110 so that the image taken by the image pickup unit 110 can be outputted to the display unit 140 according to the corrected image pickup period.

More specifically, as shown in FIG. 6, the photographed period corrector 131 corrects the photographed image photographed so that an image frame is obtained at a time point when the lamp is turned on (ON) according to the detected flicker period of the lamp, So that an image with a constant brightness can be output without flickering.

In this embodiment, the photographing cycle correction unit 131 generates a sampling time adjustment signal of the photographing cycle correction unit 131 at the time of lamp turn-on so that the blinking photographing can be performed. However, 131 may be pulled forward or backward to start shooting at a time when the lamp is turned on.

Also, it is possible to adjust the photographing interval (or the photographing interval) for adjusting the photographing interval of the photographing interval correcting unit 131 from, for example, 33 ms to 30 ms.

The photographing period is adjusted to a photographing period longer than a preset maximum permissible photographing period in consideration of a safety criterion during operation. For example, if it is determined that the blinking can be removed by adjusting the photographing period to 1 second, It is determined whether or not to adjust according to whether or not it exceeds the shooting cycle.

That is, when the vehicle moves at a speed of 100 Km / h, the distance traveled by the vehicle for 1 second is moved by a distance of about 36 m or more, so that the driver can not see any object on the image, Do not exceed the maximum shooting cycle (for example, 33 ms).

In addition, the photographing cycle correcting unit 131 corrects the photographing cycle based on the Persistence of Vision cycle (time), which is maintained for a predetermined time after the image disappears from the driver's eyes, in addition to the flicker cycle detected on the image Cycle.

In other words, the photographing period of the image photographing section 110 is corrected so that the driver has a brightness change period (for example, 40 ms or less) that can not be recognized by flickering in the inside, .

The brightness corrector 132 calculates a flicker period and a brightness using the brightness information output from the flicker detector 120. The brightness corrector 132 calculates a flicker period and brightness based on the brightness information output from the flicker detector 120. If the calculated brightness is a predetermined correction brightness value or an arbitrary lamp, And a corrected image to which the corrected brightness value is applied is output to the display unit 143. The display unit 143 displays the corrected brightness value.

In addition, the brightness correction unit 132 performs flicker correction according to the corrected brightness value only in a partial region including the correction target lamp, thereby reducing the data calculation process, Screen can be provided.

If the flickering information is not detected in the flicker detecting unit 120, the brightness correcting unit 132 outputs the image output from the image photographing unit 110 to the display unit 143.

The display unit 140 includes a display unit such as an LED, an OLED, and an LCD. The display unit 140 is configured to output an original image output from the image capturing unit 110 or a corrected image having a flicker corrected in the flicker correction unit 130.

The operation of the flicker correction system according to the present invention will now be described.

FIG. 7 is a flowchart illustrating a control method of the flicker correction system according to the present invention. FIG. 8 is a flowchart illustrating a correction process according to flicker in the flicker correction system of FIG. 7, FIG. 10 is a flowchart illustrating a process of adjusting the shooting period in the correction target determination process according to FIG.

2, 7 to 10, when the image capturing unit 110 outputs an image of at least one of front, rear, and rear sides of the vehicle, the flicker detecting unit 120 receives the captured image (S100).

The flicker detector 120 stores the image received in step S100 in a memory (not shown), analyzes the received image through a pre-stored image processing program to detect an object or a predetermined area included in the image, The brightness information including the brightness of the light, the color of the light, and the like is detected in the detected object or a certain region (S200).

In addition, the flicker detecting unit 120 analyzes the detected brightness information to determine whether the flicker occurs in an object or a certain region (for example, a band-shaped region having a width of a predetermined size from the center of the image to the upper / lower / left / , Or a rectangular area, etc.) on the received image by comparing the brightness information sequentially detected through the image processing program to determine an object or a certain area where flicker occurs and a brightness change due to the blinking S300).

The brightness change caused by the blinking in step S300 is a result of comparing the image sequentially input after receiving the first image and determining whether flickering occurs according to the change in brightness.

The detection of flicker occurrence in step S300 includes analyzing whether the occurrence of aliasing is caused by the relationship between the high frequency signal of the LED lamp and the camera sampling period by the periodic analysis.

In other words, if the cycle of the flicker signal is analyzed and the cycle is expressed as one, the image capturing cycle is adjusted to capture the image again, and the cycle is judged to be flicker in the case where the analyzed period is the same one or in an identifiable flicker It is excluded from blink compensation.

Also, if the result of the periodic analysis is not expressed by a finite number of periodic combinations, it is determined that the flicker is caused by an irregular natural phenomenon, and it is determined that the flicker correction is excluded.

If the flicker is detected in step S300, the flicker detector 120 determines whether the brightness change has occurred in the flicker correction object object (S400). If it is determined in step S400 that the flicker correction object is generated, S500). If the flicker is not detected in step S300, an original image is output through the display unit 140 (step S600).

In step S400, the flicker detector 120 may detect not only the lamps installed in the vehicle such as a head lamp, a fog lamp, a brake light, a tail lamp, and a turn signal lamp, but also a signal lamp, a road sign, And the shape of the lamp that outputs light in the vehicle other than the vehicle.

In step S400, the flicker detector 120 compares the flicker cycle according to the brightness change analyzed in the image with the flicker cycle of the lamp through PWM control, the flicker cycle for controlling the turn signal lamp, and the like, In the case of periodic flicker to be checked for control of the turn signal lamp, it shall be excluded from the flicker correction.

In step S400, the flicker detector 120 sets a relatively large lamp among the lamps or the detected lamps as a reference when a plurality of lamps are detected in the object, for example, And detects the flicker period according to the brightness change of the light source.

If the flicker is detected through PWM control in step S400, the flicker correction unit 130 corrects the detected flicker to be removed from the image (S500), and the flicker-free corrected image is output through the display unit 140 (S600).

In step S500, the flicker correction unit 130 detects a flicker period using the brightness information output from the flicker detector 120 (S510) and compares the flicker period with the image capturing period of the image capture unit 110 (S520) The photographing period correction value is calculated so as to eliminate the flicker or minimize the flicker (S530).

If the photographing period correction value is calculated in step S530, the flicker correction unit 130 transmits the calculated photographing period correction value to the image photographing unit 110 in step S540, So that the flicker-free image can be obtained.

After performing step S540, the flicker detecting unit 120 analyzes the image output through the image photographing unit 110 to detect whether blinking occurs (S550).

If it is determined in step S550 that the flicker is detected, a brightness change and a brightness value due to flicker are detected in the photographed image according to the corrected photographing period so that the corrected image can be displayed more smoothly (S560).

The flicker correction unit 130 corrects the brightness of a part of the area where the flicker or brightness change is detected in step S560 to a preset correction brightness value in step S570 and generates an image in which the flicker is eliminated in step S580, The generated corrected image is outputted through the display unit 140 (S600).

In step S730, the flicker detection unit 120 analyzes the received image in step S700. In step S710, the flicker detection unit 120 identifies a type of the flicker in step S7230.

The flicker detector 120 compares the found flicker target lamp with a previously stored lamp to determine whether a matching lamp exists (S730).

If it is determined in step S730 that there is a matching lamp, the flicker detector 120 searches for a flicker cycle for each type of stored lamp in step S740. In step S740, The flicker period of the target lamp is calculated (S750).

The flicker detecting unit 120 compares the flicker period calculated in step S750 with the period searched in step S740 and determines whether the flicker period has a similar period in step S760.

As a result of the determination in step S760, if the flicker detection unit 120 determines that the blinking target lamp found in step S710 is excluded from the flicker correction target (step S770) If the period does not exceed the tolerance range, it is determined to be a flicker correction target (S761).

If it is determined in step S730 that there is no matching lamp, the flicker analyzer 122 calculates a blinking period of the blinking object found in step S710 and determines whether the blinking period can be displayed in one cycle (step S800 )do.

If it is determined in step S800 that the image can be displayed in one cycle, it is determined whether the image capturing period is adjusted by a predetermined period (S810) (S810). If the image capturing period is not adjusted, (S811). If it is determined that the capturing period has been adjusted, a period of the captured image is analyzed to determine whether the capturing period is displayed in one cycle, which is the same as the image capturing period before the capturing period is adjusted (S820).

As a result of the determination in step S820, if the same period is determined, it is determined that flicker is possible, and the flicker is not subjected to flicker correction (step S830).

If the flicker period is changed after adjusting the image capturing period in step S820, the flicker analyzer 122 determines that the high frequency flicker is an aliasing phenomenon occurring in relation to the sampling period of the camera, (S821).

On the other hand, if the result of the determination in step S800 is that it can not be displayed in one cycle or is not represented by a combination of a finite number of cycles, the flicker analyzer 122 determines flicker due to an irregular natural phenomenon, S901).

Therefore, when the flicker is detected in the image taken by the camera, the image is corrected to the image which is obtained by removing the flicker, thereby providing the image that the driver sees as naked eyes and feeling the same as the result recognized by the driver Thereby providing a sense of stability and reducing fatigue in the eyes of the driver.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims. It can be understood that

In the course of the description of the embodiments of the present invention, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation, , Which may vary depending on the intentions or customs of the user, the operator, and the interpretation of such terms should be based on the contents throughout this specification.

100: Flashing compensation system
110: Image shooting unit
120: flicker detecting section
121: Image analysis unit
122:
130:
131:
132: Brightness correction section
140:

Claims (17)

An image capturing unit 110 installed in the vehicle and outputting an image of the surroundings of the vehicle;
An image sensing unit 110 for sensing an object or a predetermined area included in the image through an image processing program stored in advance and for detecting brightness information including a brightness value of the detected object or a predetermined area, An analyzing unit 121 for analyzing the brightness information detected by the image analyzing unit 121 to detect a blinking object or a predetermined region and analyzing a blinking period due to a brightness change in the detected object or a predetermined region And a flicker analyzer (120) for detecting a flicker correction object in response to occurrence of an aliasing phenomenon by changing the flicker period; And
And a flicker correction unit (130) for correcting the detected flicker to be removed from the image when flicker is detected in the flicker detection unit (120).
The method according to claim 1,
Wherein the flicker correction system further includes a display unit (140) for outputting the corrected image by removing flicker from the image output from the image photographing unit (110) or the flicker correction unit (130).
delete The method according to claim 1,
The flicker analyzer 122 compares the detected object with at least one shape of a head lamp, a fog light, a brake light, a tail light, a turn signal, a traffic light, a road sign, and a street light stored in advance to determine whether or not the object is a flicker correction target Features a flicker correction system.
5. The method of claim 4,
Wherein the flicker analyzing unit (122) determines to be an object to be corrected when a predetermined ON / OFF period is detected in a predetermined shape in a predetermined area of a predetermined image area of interest, which is not an object to be corrected.
5. The method of claim 4,
When a plurality of objects to be corrected are detected, the flicker analyzer 122 compares the flicker period with a previously stored flicker correction determination reference value, And adjusts a flicker cycle according to a result of the comparison to set a target that is easy to remove flicker as a representative correction target.
5. The method of claim 4,
Wherein the flicker analyzing unit (122) detects a flicker cycle for each image region in which the flicker is detected on the image.
The method according to claim 1,
Wherein the flicker analyzer (122) compares the flicker frequency with a previously stored reference value for flicker correction determination, and sets the flicker frequency to a correction target or excludes the correction target according to a result.
The method according to claim 1,
The flicker analyzer 122 finds a flicker object included in the image, identifies a type according to the lamp shape, compares the flicker target lamp with the previously stored lamp to determine whether a matching lamp exists, The blinking cycle of the lamp to be detected is searched for by the type of the stored lamp, and the blinking cycle of the found blinking lamp is compared with the searched cycle. If the blinking cycle is a similar cycle, the blinking lamp is blinked And the flicker correction target is determined to be a flicker correction target if it is not similar.
10. The method of claim 9,
The flicker analyzing unit 122 analyzes the flicker period, and when the period is displayed in one cycle, it changes the capture period of the image to recapture the image, and analyzes the cycle to analyze the image capture cycle before the capture cycle The flicker correction unit determines that the flicker is a flicker that can be confirmed by the flicker correction unit, and excludes the flicker from the flicker correction target.
delete 11. The method of claim 10,
Wherein the flicker analyzing unit (122) determines that flicker due to an irregular natural phenomenon is not present if the periodic analysis result is not represented by a finite number of periodic combinations, and excludes the flicker from the flicker correction target.
The method according to claim 1,
The flicker correction unit 130 includes a photographing period correction unit 131 for outputting a photographing period correction signal such that the photographing period of the image photographing unit 110 is flicker corrected using the flickering period detected by the flickering detection unit 120 The flicker correction system comprising:
14. The method of claim 13,
Wherein the photographing cycle is adjusted by adjusting the photographing start time or adjusting the photographing interval so that the detected flickering cycle is included in the cycle of capturing the image, or adjusting the photographing start time and the photographing interval together. .
14. The method of claim 13,
Wherein the corrected photographed period is determined such that the flicker is corrected on the basis of either a flicker period detected on the image or a Persistence of Vision period in which the image is held for a certain period of time after the image disappears in the driver. Correction system.
16. The method of claim 15,
Wherein the flicker correction unit (130) includes a brightness correction unit (132) for correcting flicker by correcting the brightness of a flickering area of the image with a preset brightness value or a brightness value determined by image analysis .
The method according to claim 1,
Wherein the flicker correction system is installed in an image sensor of a camera, an image processor (ISP) for image processing, a control device receiving a camera image, and a display device.

Images