KR101444101B1 - Apparatus for processing digital image and method for controlling thereof - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital image processing apparatus and a control method thereof that can perform dynamic image processing capable of obtaining an image of optimized quality according to a given photographing condition. According to another aspect of the present invention, Measuring an imaging environment in which the input image is input; Setting an image processing setting value for image processing on the input image; Processing the input image according to a set image processing setting value to generate a corrected image; And storing the corrected images for two or more input images continuously input.

Description

[0001] The present invention relates to a digital image processing apparatus and a control method thereof,

The present invention relates to a digital image processing apparatus and a control method thereof, and more particularly, to a digital image processing apparatus and a control method thereof, in which a moving image is inputted through an image pickup element, To a digital image processing apparatus and a control method thereof.

Typically, the digital image processing apparatus includes all apparatuses that process images of a digital camera, a PDA (personal digital assistant), a phone camera, a PC camera, or the like and use an image recognition sensor.

The digital image processing apparatus can process an image received through an image pickup device in a digital signal processor, compress the image to generate an image file, and store the image file in a memory.

The setting items such as F number, shutter speed, and sensitivity (ISO) are set to the respective setting values so that the user can shoot the desired image or the optimum image in a given environment, and the setting values set for the respective setting items So that the photographing can be performed.

On the other hand, the digital image processing apparatus can perform motion picture capturing in units of frames at regular time intervals. Each of the images is processed by a digital signal processor and compressed to generate a moving image file, and the generated moving image file can be stored.

An object of the present invention is to provide a digital image processing apparatus and a control method thereof capable of performing dynamic image processing capable of obtaining an image of optimized quality in accordance with a given photographing condition.

According to another aspect of the present invention, Measuring an imaging environment in which the input image is input; Setting an image processing setting value for image processing on the input image; Processing the input image according to a set image processing setting value to generate a corrected image; And storing the corrected images for two or more input images continuously input.

And changing the image processing setting value for image processing of the input image when the photographing environment is changed.

And an image processing setting value for image processing of the input image may be set according to the measured photographing environment.

According to another aspect of the present invention, there is provided an image processing apparatus including an image input unit receiving an input image; A photographing environment measuring unit for measuring a photographing environment in which the input image is input; And a control unit for setting an image processing setting value for image processing of the input image according to the photographing environment and processing the input image according to a set image processing setting value to generate a corrected image. And a storage unit for storing the corrected images of two or more input images continuously input.

According to the digital image processing apparatus and the control method therefor according to the present invention, it is possible to obtain a moving image with optimized quality according to a given photographing condition.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a rear view of a digital camera 100 according to an exemplary embodiment of the present invention.

Referring to FIG. 1, a direction button 21, a menu-OK button 22, a wide angle-zoom button W, a telephoto-zoom button Zoom ) Button T, a display panel 25, and the like.

The direction button 21 may include a total of four buttons including an up button 21a, a down button 21b, a left button 21c, and a right button 21d. The direction button 21 and the menu-OK button 22 are keys for inputting various menus related to the operation of the digital image processing apparatus such as a digital camera.

Wide angle-zoom button W or telephoto-zoom button T widens the view angle or narrows the view angle depending on the input. In particular, it can be used to change the size of the selected exposure area. As the display panel 25, an image display device such as a liquid crystal display (LCD) may be used.

The display panel 25 may be included in a display portion (470 of FIG. 4) in which a moving picture that has been shot and image-corrected according to the present invention can be played.

A shutter release button 26, a flash (not shown), a power switch 28, and a lens unit (not shown) may be provided on a front surface or a top surface of the digital camera 100. In addition, an objective lens and an eyepiece lens of the viewfinder 27 may be provided on the front and rear surfaces of the digital camera 100.

The direction button 21, the menu-OK button 22, the shutter release button 26, and the power switch 28 are included in a user operation unit (460 of FIG. 4) .

The shutter release button 26 is opened and closed to expose an image pickup element or film such as a CCD (Charge Coupled Device) to light for a predetermined time. Further, the shutter release button interlocks with an iris (not shown) to appropriately expose the subject to record the image on the imaging element.

On the other hand, the shutter release button 26 can be pressed in two stages. The first signal S1 is generated when the shutter release button 26 is pressed at one end, and the second signal S2 is generated when the shutter release button 26 is depressed at this end. The photographing preparation operation is performed by the first signal S1, and the photographing can be performed by the second signal S2.

As an embodiment of a digital image processing apparatus to which the present invention can be applied, a digital camera, a control apparatus thereof, and a control method thereof are disclosed in U.S. Patent Application Publication No. 2004/0130650 (titled: An automatic focusing method, and a quadratic function in camera.

The digital camera, its control device, and control method disclosed in the above-mentioned U.S. application are incorporated in this specification, and a detailed description thereof will be omitted.

2 is a block diagram of a control apparatus 200 of a digital image processing apparatus according to a preferred embodiment of the present invention. The control device 200 of the digital image processing apparatus can be installed inside the digital camera 100 of FIG.

Referring to the drawings, an optical system (OPS) including a lens unit and a filter unit optically processes light from a subject. The lens unit of the optical system OPS includes a zoom lens, a focus lens, and a compensation lens. When the user presses the wide-zoom button W or telephoto-zoom button T included in the user input unit INP, a corresponding signal is input to the microcontroller 212.

Accordingly, as the microcontroller 212 controls the lens driving unit 210, the zoom motor M _Z is driven to move the zoom lens. That is, when the wide-angle zoom button W is depressed, the focal length of the zoom lens is shortened to enlarge the angle of view, and if the telephoto-zoom button T is depressed, the focal length of the zoom lens becomes long and the angle of view becomes narrow.

Meanwhile, in the auto focusing mode, the main controller built in the digital signal processor 207 controls the lens driving unit 210 through the micro controller 212, so that the focus motor M _F is driven do. That is, the focus motor M _F is driven to move the focus lens to a position where the sharpest picture can be obtained. The auto focus mode may be performed according to the first signal S1 generated by pressing the shutter release button input through the user input unit INP at one time.

The compensation lens compensates for the overall refractive index and is not driven separately. Reference symbol M _A denotes a motor for driving an aperture (not shown).

In the filter section of the optical system (OPS), an optical low pass filter removes optical noise of a high frequency component. Infra-red cut filter blocks the infrared component of incident light.

The photoelectric conversion unit OEC may include an image pickup device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor). The photoelectric conversion unit OEC converts light from the optical system OPS into an electrical analog signal.

The analog-to-digital conversion unit may include a CDS-ADC (Correlation Double Sampler and Analog-to-Digital Converter) The analog-to-digital converter processes the analog signal from the photoelectric converter (OEC), removes the high-frequency noise, adjusts the amplitude, and converts the analog signal into a digital signal. Here, the digital signal processor 207 controls the timing circuit 202 to control the operations of the photoelectric conversion unit (OEC) and the analog-digital conversion unit 201.

The optical system OPS, the photoelectric conversion unit OEC, and the CDS-ADC 201 may be included in the image input unit 410 of FIG. 4 according to the present invention.

The real-time clock 203 provides time information to the digital signal processor 207. The digital signal processor 207 processes digital signals from the CDS-ADC device 201 to generate digital image signals classified into luminance (Y value) and chromaticity (R, G, B) signals.

A self-timer lamp, an auto-focus lamp, a mode indicating lamp, a flash standby lamp, and the like are connected to the light emitting unit (LAMP) driven by the microcontroller 212 under the control of the main controller incorporated in the digital signal processor 207 .

The digital signal processor 207 and / or the microcontroller 212 may be included in the controller (430 of FIG. 4) according to the present invention. In addition, the user input inputted by the operation of the user operation unit (460 of FIG. 4) according to the present invention is inputted to the digital signal processor 207 and / or the micro controller 212 through the user input unit INP and processed, The work can be performed accordingly.

A digital image signal from the digital signal processor 207 is temporarily stored in a DRAM (Dynamic Random Access Memory) 204. An EEPROM (Electrically Erasable and Programmable Read Only Memory) 205 stores algorithms and setting data such as a boot program and a key input program necessary for the operation of the digital signal processor 207. In the memory card interface 206, a user's memory card can be attached and detached.

The memory card recognized through the DRAM 204 or the memory card interface 206 is stored in the first storage unit 440 and / or the second storage unit 440 of FIG. 4 as the photographed and corrected image is temporarily or non- (450).

The digital image signal from the digital signal processor 207 is input to the display panel driver 214, thereby displaying an image on the display panel 215. [ At this time, the display panel 215 may be driven by the display panel driver 214.

The display panel 215 and the display panel driving unit 214 may display an input image and a corrected image according to the present invention and may be included in a display unit 470 in which the corrected image can be played as a moving image.

On the other hand, the digital image signal from the digital signal processor 207 can be transmitted by serial communication through a USB (Universal Serial Bus) connection part 31a or an RS232C interface 208 and its connection part 31b, 209 and the video output unit 31c as video signals. Here, the digital signal processor 207 may incorporate a micro controller therein.

The audio processor 213 outputs the audio signal from the microphone MIC to the digital signal processor 207 or the speaker SP and outputs the audio signal from the digital signal processor 207 to the speaker SP.

FIG. 3 is a flowchart of a control method (S300) of a digital image processing apparatus according to a preferred embodiment of the present invention. The control method S300 of the digital image processing apparatus may be implemented in the control apparatus 200 of the digital image processing apparatus of FIG. 2 and / or the digital image processing apparatus 400 of FIG.

To this end, the control method (S300) of the digital image processing apparatus according to the present invention may be a program or algorithm stored in the storage means of FIG. 2 or implemented in the form of a semiconductor chip such as a firmware.

The control method S300 of the digital image processing apparatus according to the present invention is a method of controlling the digital image processing apparatus according to the present invention by applying dynamic image processing according to the shooting environment at the time of shooting a moving image using the digital image processing apparatus, do.

That is, various image processing techniques can be applied to improve the image quality of a still image or a moving image using a digital image processing apparatus. Such image processing techniques may include image correction techniques such as noise reduction, sharpness improvement, gamma curve modification, and color correction.

In order to obtain a corrected image by correcting the input image by such an image processing technique at the time of capturing a moving image, the image capturing environment is measured at the time of capturing a moving image and the image processing setting values necessary for each image processing are set according to the image capturing environment . That is, when the shooting environment at the time of shooting a moving picture is changed, at least a part of the setting values for image processing can be changed to a setting suitable for the shooting environment.

The conventional digital image processing apparatus can differently apply image processing for image correction according to each shooting scene at the time of shooting a still image. However, at the time of video shooting, the image processing settings set immediately before shooting are applied until the video shooting ends.

In the case where the image is corrected by the same image processing setting even when the shooting conditions are changed during shooting of the moving image, problems such as noise increase or sharpness decrease may occur depending on the changed shooting environment.

On the other hand, the processing capacity and memory size of the digital image processing apparatus are increasing. Accordingly, various image processes can be performed within a range that does not affect the storage of moving pictures even during moving picture shooting.

In the digital image processing apparatus, the current brightness can be calculated according to the brightness of the shooting environment, and the change in the color temperature can be calculated. By using this measurement method, it is possible to calculate and recognize the photographing conditions photographed at the present digital image processing apparatus in real time. In particular, such measurements can be made during video recording.

That is, it is possible to perceive the photographing environment which changes at the time during moving picture photographing, and perform dynamic image processing according to the change of the photographing environment to perform image correction for each frame. Accordingly, it is possible to realize excellent moving picture quality even in an environment where shooting conditions vary widely.

To this end, the control method (S300) of the digital image processing apparatus includes an image input step (S310); A photographing environment measuring step (S320); An image processing setting changing step (S330, S340); A corrected image generating step (S350); And a moving image storing step (S370).

In the image input step S310, an input image is input. In the photographing environment measuring step S320, the photographing environment in which the input image is input is measured. In the image processing setting changing step (S330, S340), the image processing setting value for the image processing for the input image is changed when the photographing environment is changed.

In the corrected image generation step S350, the input image is processed according to the set image processing set value to generate a corrected image. In the moving image storage step S370, the correction images for two or more input images continuously input are stored as a moving image file.

In addition, the control method (S300) of the digital image processing apparatus may further include an image processing setting step of setting image processing setting values for image processing on the input image in advance. At this time, a preset default value may be used for the image processing setting step.

As another embodiment, the image processing setting step may set the image processing setting values suitable for the measured photographing environment after measuring the photographing environment in advance at the start of the moving image photographing.

The input image input in the image input step S310 is inputted through the image input unit 410 shown in FIG. 4 including the optical system OPS, the photoelectric conversion unit OEC, the CDS-ADC 201, . At this time, the input image may be one of the moving images continuously input through the image input unit (410 of FIG. 4) at a predetermined time interval.

In the photographing environment measuring step S320, the photographing environment in which the input image is input is measured. The photographing conditions are set according to the measured photographing environment, and photographing can be performed accordingly. In this case, the image processing setting value may be set according to the photographing conditions according to the photographing environment.

The measurement of the shooting environment may be performed at a constant time interval or at a constant frame interval. However, the present invention is not limited to this, and the photographing environment may be measured at an adaptive interval in accordance with a changed frame interval or a changed time interval according to the degree of change of the photographing environment. On the other hand, the photographing environment may be measured in units of frames.

The photographing environment to be measured may be at least one of brightness and color temperature information of the surroundings. That is, the shooting environment to be measured may be exposure information or color temperature information measured and calculated for automatic exposure adjustment (Auto Exposure) adjustment or auto white balance adjustment.

In the image processing setting change step (S330, S340), the image processing setting value for image processing for the input image is changed when the photographing environment is changed. If it is determined that the shooting environment has changed, the image processing setting value for the image processing of the input image may be changed (S340).

At this time, it is determined whether the shooting environment has been changed (S330). If it is determined that the shooting environment has not been changed, a predetermined setting value may be used without changing the image processing setting value for the image processing of the input image .

The change of the photographing environment detects a change amount of the measured photographing environment or a photographing condition variable. If the change amount is larger than the set reference value, it is determined that the photographing environment has been changed. If the change amount is smaller than or equal to the set reference value, It can be judged.

In another embodiment, the imaging environment is measured at a predetermined frame interval or a predetermined time interval, and an image processing setting value for image processing of the input image is set according to the measured imaging environment.

In the corrected image generation step S350, the input image is processed according to the set image processing set value to generate a corrected image. The image processing method for generating the corrected image may be at least one of noise reduction, edge enhancement, and gamma curve adjustment.

As a specific example, the shooting environment may be measured with luminance and the respective settings for noise reduction, edge enhancement, and gamma curve adjustment may be varied depending on the degree of brightness. At this time, the luminance region is divided into two or more regions, and accordingly, the respective setting values for noise reduction, edge enhancement, and gamma curve adjustment can be adjusted differently.

The luminance region is divided into a low luminance lower than the first reference value for which the luminance is set and a normal luminance between the first reference value and the second reference value whose luminance is higher than a second reference value, . At this time, when the measured luminance is included in the low luminance region, the noise reduction setting can be set to high and the edge enhancement can be set to low.

Further, when the measured luminance is included in the normal luminance region, the noise reduction setting can be set to meddle and the edge enhancement can be set to meddle. In addition, when the measured luminance is included in the high luminance region, the noise reduction setting can be set low and the edge enhancement can be set high.

That is, when the shooting environment changes to dark during moving picture shooting, noise reduction during motion picture shooting can be minimized by increasing the setting of noise reduction and by setting the edge enhancement setting lower.

Further, when measured by backlight, it is possible to set the edge enhancement to high and change the gamma curve slope.

That is, when the shooting environment is determined to be a backlight scene in which a bright light source exists in the background of the subject during moving picture shooting, by changing the setting of the edge enhancement and changing the setting of the gamma curve, the face of the subject is photographed brightly and clearly So that the background can be photographed without being saturated.

In the moving image storage step S370, the correction images for two or more input images continuously input are stored as a moving image file.

According to the control method (S300) of the digital image processing apparatus according to the present invention, dynamic image processing is applied according to the shooting environment at the time of shooting a moving image using the digital image processing apparatus, thereby obtaining optimized moving image quality according to the shooting environment .

FIG. 4 is a block diagram of a digital image processing apparatus 400 according to a preferred embodiment of the present invention. The digital image processing apparatus 400 can be controlled by a control method (S300) of the digital image processing apparatus shown in FIG.

Referring to the drawings, the digital image processing apparatus 400 includes an image input unit 410; A photographing environment measuring unit 420; A control unit 430; Storage units 440 and 450; A display unit 460; And a user operation unit 470. The digital image processing apparatus 400 is controlled by a control method (S300) of the digital image processing apparatus shown in FIG. 3, and reference is made to the same points as in the explanation of FIG.

The image input unit 410 receives an input image. The photographing environment measuring unit 420 measures the photographing environment in which the input image is input. The control unit 430 sets image processing setting values for image processing of the input image according to the photographing environment, and processes the input image according to the image processing setting values to generate a corrected image.

The storage units 440 and 450 store correction images for two or more input images continuously input. The user manipulation unit 460 manipulates the user to input a desired command from the outside. The input image and the corrected image may be displayed on the display unit 470, and the corrected image may be played as a moving image.

The image input unit 410 receiving the input image may include an optical system (OPS), a photoelectric conversion unit (OEC), a CDS-ADC device 201, and the like of FIG.

The photographing environment measuring unit 420 measures the photographing environment in which the input image is input. The measurement of the shooting environment may be performed at a constant time interval or at a constant frame interval. However, the present invention is not limited to this, and the photographing environment may be measured at an adaptive interval in accordance with a changed frame interval or a changed time interval according to the degree of change of the photographing environment. On the other hand, the photographing environment may be measured in units of frames.

The photographing environment to be measured may be at least one of brightness and color temperature information of the surroundings. That is, the shooting environment to be measured may be exposure information or color temperature information measured and calculated for automatic exposure adjustment (Auto Exposure) adjustment or auto white balance adjustment.

The control unit 430 sets image processing setting values for image processing of the input image according to the photographing environment, and processes the input image according to the image processing setting values to generate a corrected image.

The photographing environment is measured at a predetermined frame interval or a predetermined time interval, and an image processing setting value for image processing of the input image can be set according to the measured photographing environment. The input image is processed to be corrected according to the set value thus generated, so that the corrected image can be generated.

At this time, image processing setting values for image processing of the input image may be set in advance. That is, a preset default value may be used as the set value.

In this case, the image processing setting value for image processing for the input image is changed when the photographing environment is changed. To this end, it is determined whether or not the photographing environment has been changed first. If it is determined that the photographing environment has been changed, the image processing setting value for the image processing for the input image may be changed.

At this time, it is determined whether the photographing environment has been changed. If it is determined that the photographing environment has not been changed, a preset value may be used without changing the image processing setting value for the image processing for the input image.

In addition, a corrected image can be generated by processing an input image according to a set image processing setting value. The image processing method for generating the corrected image may be at least one of noise reduction, edge enhancement, and gamma curve adjustment.

At this time, when the shooting environment changes to dark during moving picture shooting, noise reduction during motion picture shooting can be minimized by increasing the setting of noise reduction and decreasing the setting of edge enhancement.

Further, when the shooting environment is determined to be a backlight scene in which a bright light source exists in the background of the subject during motion picture shooting, by changing the setting of the edge enhancement and changing the setting of the gamma curve, the face of the subject is photographed brightly and clearly So that the background can be photographed without being saturated.

The storage unit 440 and 450 may store the input image and the corrected image. In addition, the correction images for two or more input images continuously input to the storage units 440 and 450 may be stored as moving images.

The storage units 440 and 450 may include a first storage unit 440 and a second storage unit 450. At this time, the input image and the corrected image may be temporarily stored in the first storage unit 440. In the second storage unit 740, the correction images for two or more input images continuously input can be stored as a moving image file in a nonvolatile manner.

The first storage unit 440 may be a DRAM (204 in FIG. 2) or a cache memory for temporarily storing data. The second storage unit 450 may be a flash memory or a memory card recognized through a memory card interface (206 in FIG. 2) or the like in which data is stored in a nonvolatile manner.

The user manipulation unit 460 manipulates the user to input a desired command from the outside. The direction buttons (21 in FIG. 1), the menu-OK button (22 in FIG. 1), the shutter release button (26 in FIG. 1), and the power switch (28 in FIG. 1) have.

In the display unit 470, the input image is corrected and the stored correction image can be played as a moving image.

According to the digital image processing apparatus 400 according to the present invention, by applying dynamic image processing according to the photographing environment at the time of photographing a moving image, optimized moving image quality can be obtained according to the photographing environment.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, You will understand. Accordingly, the true scope of protection of the present invention should be determined only by the appended claims.

FIG. 1 is a view showing the external appearance of a digital camera according to an embodiment of the digital image processing apparatus according to the present invention.

FIG. 2 is a block diagram schematically illustrating a control device that may be included in the digital camera of FIG. 1. Referring to FIG.

3 is a flowchart schematically showing a control method of a digital image processing apparatus according to a preferred embodiment of the present invention.

4 is a block diagram schematically illustrating a digital image processing apparatus according to a preferred embodiment of the present invention.

Claims (12)

Receiving an input image; Measuring an imaging environment in which the input image is input; Setting an image processing setting value for image processing on the input image; Processing the input image according to a set image processing setting value to generate a corrected image; Temporarily storing the corrected images of two or more input images continuously input in a first storage unit; And And storing the corrected images as a moving image file in a second storage unit. The method according to claim 1, Wherein the measurement of the photographing environment is performed at a constant time interval or at a constant frame interval. The method according to claim 1, Wherein the photographing environment to be measured is at least one of ambient brightness and color temperature information. The method according to claim 1, Wherein the image processing is at least one of noise reduction, edge enhancement, and gamma curve adjustment. The method according to claim 1, And changing the image processing setting value for image processing of the input image when the photographing environment is changed. The method according to claim 1, And setting an image processing setting value for image processing of the input image according to the measured photographing environment. A video input unit receiving an input video; A photographing environment measuring unit for measuring a photographing environment in which the input image is input; And A control unit for setting an image processing setting value for image processing of the input image according to the photographing environment and processing the input image according to a set image processing setting value to generate a corrected image; And And a storage unit for storing the corrected images of two or more input images continuously input, The storage unit, A first storage unit in which each of the corrected images is temporarily stored, and And a second storage unit for storing the corrected images of two or more input images continuously input as motion picture files. delete 8. The method of claim 7, Wherein the measurement of the photographing environment is performed at a constant time interval or at a constant frame interval. 8. The method of claim 7, Wherein the photographing environment to be measured is at least one of brightness and color temperature information of the surroundings. 8. The method of claim 7, Wherein the image processing is at least one of noise reduction, edge enhancement, and gamma curve adjustment. 8. The method of claim 7, Wherein the image processing setting value for the image processing of the input image is changed when the photographing environment is changed.

Images