KR101575629B1 - Apparatus for processing digital image and method for controlling the same - Google Patents

Abstract

[0001] The present invention relates to a digital image processing apparatus and a control method thereof, and more particularly, to a digital image processing apparatus and a control method thereof that are capable of moving a shake correction center frequency to measure a shake or a shake pattern of a photographer, An image processing apparatus and a control method thereof.

The photographer or the user of the digital image device may vary in the pattern of shaking (or shaking) depending on various age, sex, and various physical conditions.

Therefore, although the shake pattern of each user must be considered for the optimum shake correction, the shake correction apparatus of the conventional digital image processing apparatus does not consider the shake (or shake) of each photographer, ) Can not be corrected.

The present invention provides a digital image processing apparatus and a control method thereof for solving the problem of the shake correction of the conventional digital image processing apparatus.

Description

[0001] Digital image processing apparatus and control method thereof [0002]

[0001] The present invention relates to a digital image processing apparatus and a control method thereof, and more particularly, to a digital image processing apparatus and a control method thereof that are capable of moving a shake correction center frequency to measure a shake or a shake pattern of a photographer, An image processing apparatus and a control method thereof.

The digital image processing apparatus includes all devices that process images of a digital camera, a PDA (personal digital assistant), a phone camera, a PC camera, or the like and use an image recognition sensor.

The digital image processing apparatus can directly display an image received through an image pickup device on an image display device or store the image as a file.

A digital image processing apparatus such as a camera may be shaken due to camera shake when a photographer takes a desired image by utilizing the digital image processing apparatus.

That is, when a desired image is photographed by a photographer, a shake (or camera shake) may cause the image input through the image sensor to shake, so that the photographing may fail.

In particular, digital image processing apparatuses can be easily shaken at the time of photographing in accordance with the trend of downsizing and slimming of recent digital image processing apparatuses.

The shake (or shake) correcting device is a device for photographing a clear image by correcting the shake of the image pickup device when the image is not clearly captured due to shaking of the image pickup device due to camera shake or the like at the time of photographing.

The shake (or shake) correction device largely adopts a method of correcting optical shake or a method of correcting shake by software.

The optical correction method is divided into a method of correcting the image by moving the lenses in a manner to offset the shake of the imaging device, and a method of correcting the image by moving the image sensor in such a manner as to offset the shake of the imaging device.

The software correction method is a method in which an image is processed in software (for example, in the shake correction mode, the image is processed several times for a predetermined time to process and store only the image with the least amount of shake) And a method of storing an image having the least occurrence of shaking.

However, since the algorithm for controlling the shake correction apparatus at the time of shipment of a digital image processing apparatus such as a camera is tuned constantly in a predetermined format and enters the inside, it can not be varied, The shake (or shake) correction bandwidth becomes narrow because the shake correction apparatus is operated in response to the shake (or shake) of the specific user sampled.

That is, the shake correction apparatus of the conventional digital image processing apparatus has a problem that the correction is limited because it is manufactured in accordance with sampled conditions such as a specific age or sex without considering the photographer or individual user's shake patterns.

The photographer or the user of the digital image device varies in the pattern of shaking (or shaking) according to various age, sex, and various physical conditions.

Therefore, the shake pattern of each user should be considered for the optimal shake correction. However, the shake correction apparatus of the conventional digital image processing apparatus analyzes the shake (or shake) of the photographer himself / herself by a predetermined algorithm set at the time of product production so that the shake (or camera shake) can be corrected in an optimal state There is no disadvantage.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is an object of the present invention to provide a digital image processing apparatus that measures a shake or a shake pattern of a photographer or a user, And a control method thereof.

According to an aspect of the present invention, there is provided a digital image processing apparatus comprising: an image shake detecting unit for measuring a shaking motion pattern of a photographer; A camera-shake correction frequency control unit for searching for a center frequency at which the amount of camera-shake is a peak in the camera-shake pattern signal, setting a predetermined frequency bandwidth including the searched center frequency, and setting a center frequency for the camera-shake correction within the frequency- And a correction unit that performs correction of the shaking motion of the photographer based on the set correction center frequency.

Preferably, the shake correction frequency control unit may include: a search unit for searching for a center frequency with a shake amount peak in the measured shake pattern signal; A frequency bandwidth setting unit for setting a predetermined frequency bandwidth including the center frequency; And a correction center frequency determining unit for setting a center frequency for the camera-shake correction within the frequency bandwidth.

Preferably, the searching unit may include: a comparing unit comparing the searched center frequency with a predetermined camera-shake correction center frequency; And a storage unit for storing the searched center frequency when the searched center frequency and the camera-shake correction center frequency are different from each other.

Preferably, the correction unit includes a camera-shake correction actuator that performs camera-shake correction of the photographer by moving a camera-shake correction lens position based on the set correction center frequency.

Preferably, the digital image processing apparatus according to the present invention further comprises a display unit for displaying the measured shaking motion pattern of the photographer.

According to another aspect of the present invention, there is provided a digital image processing method including: a camera-shake pattern measurement step of measuring a camera-shake pattern of a photographer; A camera-shake center frequency searching step of searching for a center frequency in which the amount of camera shake is a peak in the shake pattern signal; A frequency bandwidth setting step of setting a predetermined frequency bandwidth including the searched center frequency; A correction center frequency setting step of setting a center frequency for the camera-shake correction within the frequency bandwidth, and a camera-shake correction step of performing camera-shake correction of the photographer based on the set correction center frequency.

Preferably, the step of searching for the center of gravity may include the steps of: comparing the searched center frequency with a predetermined center of gravity correction frequency; And a storage step of storing the searched center frequency when the searched center frequency and the camera-shake correction center frequency are different from each other.

Preferably, the step of measuring a shake level, which is the degree to which the main body moves during shooting, Comparing the shaking level with a set reference level; And setting the camera shake correction mode when the shake level is equal to or higher than the reference level.

Preferably, the step of analyzing the shaking motion level after performing the shaking motion correction includes comparing the corrected shaking motion level with a predetermined correction target level, And a correction center frequency changing step of changing the camera-shake correction center frequency within the frequency bandwidth when the corrected camera-shake level does not reach the set correction target level.

According to the digital image processing apparatus and the control method thereof according to the present invention, it is possible to perform optimal shake correction according to the shaking motion pattern of the photographer or each user, and to obtain a clear image without shaking at the time of imaging using the digital image processing apparatus have.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing an unintentional hand movement pattern according to a photographer of a digital image processing apparatus.

The photographer or the user of the digital image device varies in the pattern of shaking (or shaking) according to various age, sex, and various physical conditions.

It is known that the human hand shake frequency is generally from 4 Hz to 10 Hz.

However, since a person's hand-shake frequency is different for each person and a frequency is mixed, a certain range of bandwidth can not be avoided.

1 is a view showing a result of measuring a camera-shake frequency of a digital image processing apparatus photographer.

It is presupposed that the measurement result of the shaking frequency can be changed into various forms according to the external design of the digital image processing apparatus, the weight of the image processing apparatus, the specifications of the release button, and the like.

The camera shake frequency of the photographer may be different depending on the posture of photographing or other surrounding conditions. However, since it is impossible to measure the camera shake frequency or the camera shake pattern in consideration of all these situations, And shows the result of measurement in consideration of the specifications.

For the shake frequency measurement, an angular velocity sensor such as a gyro sensor or an acceleration sensor may be used.

As an embodiment, the measurement of the hand-shake frequency by the gyro sensor will be described in detail.

A gyro sensor is a sensor that measures the rotational motion of an object, and has been widely used in an inertial navigation system.

In recent years, however, the application range has been extended to sensors for controlling the motion of mechanical devices, sensors for stabilizing the gaze of moving cameras, and sensors for measuring stability and tilt of railroad tracks.

A gyro sensor can measure the direction and acceleration of an object by using the rotation angles of yaw, pitch, and roll.

In FIG. 1, the X-axis represents the shaking frequency and the Y-axis represents the angular velocity of the shaking motion.

In FIG. 1, reference numerals 120 and 140 denote frequency patterns when the vibration direction of the gesture sensor and gyro sensor embedded in the digital image processing apparatus is a pitch (PITCH), and reference numerals 110 and 130 denote frequency patterns when the vibration direction of the gyro sensor is YAW .

It can be seen that the photographer A in Fig. 1 (a) has a large shaking in the vicinity of 3-4 Hz and the band around 7-12 Hz.

It can be seen that the photographer B in Fig. 1 (b) is shaken in the band of 2-4 Hz and 7-12 Hz, which is similar to the camera shake frequency of the photographer A in Fig. 1 (a).

However, the photographer A in (a) constitutes the peak value of the shaking in the vicinity of 3-4 Hz, but the photographer B is the peak of the shaking in the vicinity of 7-12 Hz.

That is, the camera-shake center frequency of the photographer A is 3 Hz or 4 Hz, and the camera-shake center frequency of the photographer B is 9 Hz or 10 Hz.

FIG. 1 is a graph showing that a shaking motion pattern of a photographer or a user must be considered for an optimal shake correction in a digital image processing apparatus.

If the measured camera shake center frequency is different for each photographer, it means that the center frequency shift must be changed for each photographer in order to perform the optimal shake correction.

2A is a block diagram schematically showing an internal configuration of a digital image processing apparatus according to the present invention.

The digital image processing apparatus 100 includes an image shake detecting unit 110, a control unit 120, a shake correction unit 130, and a position control unit 140.

The shake detecting unit 110 includes a shake detecting sensor unit 111 and an amplifying unit 112. The camera shake detecting unit 110 is attached to the digital image processing apparatus and senses a moving camera shake pattern of the photographer at the time of photographing.

The camera-shake detection sensor unit 111 detects the camera-shake state of the photographer at a predetermined time interval. For example, it can operate 10 times per second to detect camera shake.

An angular velocity sensor (not shown), an acceleration sensor (not shown), a gyro sensor (not shown), or the like may be used for detecting the shaking motion pattern.

The amplifying unit 112 amplifies the sensed shaking motion detection signal.

The shake sensor 110 may further include a filter unit (not shown) to remove noise of the shake detection signal output from the shake sensor unit.

The filter unit (not shown) may use either or both of a high pass filter (HPF) and a low pass filter (LPF). This can be appropriately selected in accordance with the noise component output from the shaking motion detection sensor unit.

The controller 120 receives a digital signal from the shake pattern signal amplified by the amplifier 112, calculates a correction amount corresponding to the shake sensor signal, and outputs a driving signal for driving the shake correction unit 130.

The control unit 120 includes ADCs 121 and 126, a shake correction frequency control unit 122, an amplification unit 123, a motor driving unit 124, and a DAC 125.

An ADC (Analog-Digital Converter) 121 converts the shake blur pattern signal amplified by the amplification unit 112 into a digital signal.

The camera shake correction frequency control unit 122 searches for a center frequency at which the amount of camera shake is peak in the detected camera shake pattern signal, sets a predetermined frequency bandwidth including the searched center frequency, and sets a center frequency for camera shake correction within the frequency band Setting.

FIG. 2B is a block diagram schematically illustrating the configuration of the shake correction frequency control unit of the digital image processing apparatus according to the present invention.

The camera shake correction frequency control unit 122 includes a search unit 220, a frequency band setting unit 223, and a correction center frequency determination unit 224. [

The search unit 220 searches for a center frequency at which the amount of camera shake is a peak in the measured camera shake pattern signal and further includes a comparison unit 221 and a storage unit 222 to compare and store the center frequency with a predetermined camera shake correction center frequency have.

The comparator 221 compares the searched center frequency with a preset camera-shake correction center frequency.

The storage unit 222 stores the searched center frequency when the center frequency searched for by the comparison unit 221 is different from the predetermined sway correction center frequency, and stores the searched center frequency and the predetermined camera-shake correction center frequency The camera shake correction center frequency is stored.

The frequency bandwidth setting unit 223 sets a predetermined frequency bandwidth including the center frequency searched by the search unit 220.

The correction center frequency determining unit 224 determines a correction center frequency for setting a center frequency for camera-shake correction within a set frequency bandwidth.

The camera shake correction frequency control unit 122 analyzes the shake level based on the correction center frequency and analyzes the shake level. If the camera shake correction frequency does not reach the predetermined correction target level, the shake correction unit 130 and the position control unit 140 So that the correction center frequency is changed within the frequency bandwidth set by the frequency bandwidth setting unit 223 so as to reach the correction target level through the frequency adjustment unit 223.

The correction center frequency change by the feedback control is performed in the correction center frequency changing unit (not shown).

In Fig. 1, the photographer A constitutes the peak value of the shaking in the vicinity of 3-4 Hz, while the photographer B makes the peak of the shaking in the vicinity of 7-12 Hz.

That is, the camera-shake center frequency of the photographer A is 3 Hz or 4 Hz, and the camera-shake center frequency of the photographer B is 9 Hz or 10 Hz.

For example, if it is possible to control up to 3 steps in left and right and + / - directions based on the set center frequency, the photographer 'A' will have a main camera shake correction frequency control bandwidth (center frequency 4 Hz) of 1 Hz to 7 Hz, If 'B' is set to 9Hz, the main camera shake correction frequency control bandwidth is 6Hz - 12Hz.

The frequency control bandwidth is based on simple calculation based on the center frequency and can be applied to various applications.

The amplifying unit 123 amplifies the signal indicating the calculated correction of the shaking motion correction amount in consideration of the shaking motion pattern of the photographer in the shaking motion correction amount calculation unit 122. [

The motor driving unit 124 is a driving driver for driving the shake correction actuator 131 in accordance with the amplified correction amount signal.

A digital-analog converter (DAC) 125 converts the digital signal output from the motor driver 124 into an analog signal and outputs the analog signal to the camera shake correction actuator 131.

 The camera shake correcting unit 130 corrects camera shake at the time of photographing according to the shake level.

The camera shake correcting unit 130 includes a shake correcting actuator 131 and a shake correcting lens unit 132. [

A voice coil motor, a piezoelectric motor, or the like may be used as the shake compensation actuator 131, but the protection scope of the present invention is not limited thereto, and all the driving means capable of axial driving can be used.

The shake correction actuator 131 moves the lens position of the shake correction lens unit 132 by the drive signal outputted from the control unit 120. [

The position controller 140 includes a position sensor 141 and an amplifier 142.

The position sensor unit 141 detects the position of the lens to check whether the lens of the shake correction lens unit 132 corrects correctly.

The amplifying section 142 amplifies the detected lens position signal.

The position control unit 140 checks whether the lens operation of the shake correction unit 130 is normal and feeds back the signal to the control unit 120. The control unit 120 receives the feedback signal and compares the received signal with a preset reference level, .

3 is a view showing an embodiment of measuring a shaking motion pattern of a digital image processing apparatus photographer.

The embodiment shown in FIG. 3 is characterized in that the shaking motion pattern measurement mode of Step 340 is performed after entering the shake correction mode (Step 320).

After entering the OIS (Optical Image Stabilizer) mode, the photographer determines whether to select the camera shake measurement mode (step 340).

When the camera shake pattern measurement mode is selected, the image processing device measures the camera shake pattern of the photographer and determines the camera-shake center frequency with the highest frequency of occurrence in the camera shake pattern (Step 360).

When the center frequency of the measured camera shake is compared with the camera shake correction center frequency already set in the image processing apparatus, the camera shake correction is performed using the camera shake correction center frequency that has been set previously.

If the measured center frequency of the hand movement is different from the center frequency set in the image processing apparatus, the measured center frequency of the hand movement is stored in the memory means (step 380).

As the memory means, an EEPROM (Electrically Erasable Programmable Read Only Memory) may be used.

The digital image processing apparatus 100 according to the present invention displays a series of processes for measuring a shaking motion pattern of a photographer on a display unit so that the photographer can directly check the shape of his or her shaking motion pattern have.

When the measurement of the camera shake pattern of the photographer is completed, the display unit displays that the measurement is completed so that the photographer can recognize the measurement (Step 390).

4 is a view showing another embodiment for measuring a shaking motion pattern of a digital image processing apparatus photographer.

The embodiment shown in FIG. 4 shows an embodiment in which hand movement pattern measurement can be performed even when the hand shake correction mode is not set, unlike the embodiment shown in FIG.

If the power of the image processing apparatus is supplied (Step 410), it is possible to switch directly to the camera-shake pattern measurement mode regardless of whether or not the camera-shake correction mode state is present (Step 420).

The performance of the image processing apparatus after entering the shake pattern measurement mode is the same as that shown in Fig.

That is, if the camera shake pattern measurement mode is selected, the image processing device measures the camera shake pattern of the photographer and determines the camera-shake center frequency with the highest frequency of occurrence in the camera shake pattern (Step 450).

When the center frequency of the camera shake is compared with the camera-shake correction center frequency already set in the image processing apparatus, the camera-shake correction is performed using the camera-shake correction center frequency that has been set ).

When the center frequency of the camera shake is different from the center frequency of the camera, the measured camera shake center frequency is stored in the memory (step 460).

5 is a view showing another embodiment for measuring a shaking motion pattern of a digital image processing apparatus photographer.

5 is characterized in that it is possible to select whether or not to measure the shaking motion pattern when the power of the image processing apparatus is supplied (Step 510) without entering the shaking motion pattern measurement mode.

That is, the photographer of the image processing apparatus determines whether to measure the shaking motion pattern through a display unit (step 520).

If you do not select the shake pattern measurement, you can shoot immediately without performing the shake pattern measurement.

When the shaking motion pattern measurement is selected, the shaking motion pattern is measured (S540) as shown in FIGS. 3 and 4, and the measured center frequency of the shaking motion pattern is compared with the existing center frequency (Step 550) If not, the measured center frequency is stored in the memory means (step 570).

6 is a view showing another embodiment for measuring a shaking motion pattern of a digital image processing apparatus photographer.

In the embodiment shown in FIG. 6, if the power of the image processing apparatus is supplied (Step 610) without entering the shake pattern measurement mode, the shake pattern is measured for a predetermined time (Step 620).

Unlike Fig. 5, the shake pattern measurement progress is not displayed on the display unit (not shown). That is, the image processing apparatus measures the shaking motion pattern without recognizing the progress of the shaking motion pattern execution by the photographer.

As one embodiment of the embodiment of measuring the shaking motion pattern of the photographer shown in Figs. 3 to 6, the shaking motion pattern of the photographer is measured, the center frequency of the camera shake frequency of the photographer is found, If the measured center frequency is not equal to the preset center frequency value, the measured center frequency is stored in the memory means, and the stored center frequency is used The camera shake correction is performed.

The measured camera shake center frequency is used to perform camera shake correction more optimally to the shaking motion of the photographer.

FIG. 7 is a flowchart illustrating a camera shake correction procedure of the digital image processing method according to the present invention.

The digital image processing apparatus measures the shaking motion pattern of the photographer according to one embodiment of the embodiment shown in Figs. 3 to 6 (Step 710).

In step 720, the digital image processing apparatus finds the center frequency of the shaking motion most frequently occurring in the measured camera shake pattern, and sets the frequency bandwidth in the + / - direction around the found center frequency.

The camera shake correction is performed while moving the center frequency within the set bandwidth (Step 730).

The corrected shake level is compared with a correction target value (reference level), and the result is fed back to determine whether to perform shake correction again (step 740).

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, You will understand. Accordingly, the true scope of protection of the present invention should be determined only by the appended claims.

1 is a view showing an unintentional hand movement pattern according to a photographer of a digital image processing apparatus.

2A is a block diagram schematically showing an internal configuration of a digital image processing apparatus according to the present invention.

FIG. 2B is a block diagram schematically illustrating the configuration of the shake correction frequency control unit of the digital image processing apparatus according to the present invention.

3 is a flowchart showing an embodiment for measuring a camera shake pattern in a digital image processing apparatus according to the present invention.

4 is a flowchart showing another embodiment for measuring a camera shake pattern in a digital image processing apparatus according to the present invention.

5 is a flowchart showing another embodiment for measuring a camera shake pattern in a digital image processing apparatus according to the present invention.

6 is a flowchart showing another embodiment for measuring a camera shake pattern in a digital image processing apparatus according to the present invention.

FIG. 7 is a flowchart illustrating a camera shake correction procedure of the digital image processing method according to the present invention.

Claims (9)

An image shake detecting unit for measuring a shaking motion pattern at the request of a user of the digital image processing apparatus; The center frequency of the detected camera shake is compared with the predetermined center frequency of the camera shake correction, and if the detected camera shake center frequency is different from the predetermined camera shake correction center frequency, Determines the center frequency of correction as the detected center frequency of the camera shake, and determines the camera-shake correction center frequency as a predetermined camera-shake correction center frequency when the searched central frequency and the predetermined camera-shake correction center frequency are the same, A camera-shake correction frequency controller for setting a predetermined frequency bandwidth including the center frequency before the camera-shake correction and setting a center frequency for camera-shake correction within the frequency bandwidth; And And a correction unit that performs correction of the shaking motion of the user based on the center frequency for the camera shake correction. delete delete The apparatus of claim 1, wherein the correcting unit And an anti-shake actuator for moving the anti-shake lens position based on the center frequency for the set anti-shake operation to perform the anti-shake operation of the user. The method according to claim 1, And a display unit for displaying the measured shaking motion pattern of the user. A hand movement pattern measurement step of measuring hand movement patterns in response to a request from a user of the digital image processing apparatus; A camera-shake center frequency searching step of searching for a center frequency in which the amount of camera shake is a peak in the shake pattern signal; Comparing the searched center-of-gravity center frequency with a preset center-of-gravity correction frequency; If it is determined that the center of gravity of the camera shake is different from the center of gravity of the camera shake correction, the center of gravity of the camera shake is determined as the center of gravity of the camera shake. If the center of gravity of the shake is equal to the center of gravity Determining the camera-shake correction center frequency as a predetermined camera-shake correction center frequency; A frequency bandwidth setting step of setting a predetermined frequency bandwidth including the determined center-of-gravity correction frequency before the camera shake correction; And And a camera shake correction step of setting a center frequency for camera shake correction within the frequency bandwidth and performing camera shake correction of the user. delete The method according to claim 6, Measuring a shaking level, which is a degree at which the main body moves during shooting; Comparing the shaking level with a set reference level; And And setting the shake correction mode when the shake level is equal to or higher than the reference level. The method according to claim 6, Analyzing a shake level after performing the shake correction; Comparing the corrected shake level with a set correction target level; And And a correction center frequency changing step of changing the camera-shake correction center frequency within the frequency bandwidth when the corrected camera-shake level does not reach the set correction target level.

Images