KR101086413B1 - Method of controlling digital image processing apparatus wherein image shaking is corrected - Google Patents

Abstract

The present invention provides a control method of a digital image processing apparatus having a preview mode for continuously displaying incident preview images and a photographing mode for performing a photographing operation when a photographing signal is generated from a user in the preview mode. Steps (a) and (b). In step (a), in the shooting mode, an incident image is captured according to the shooting signal. In step (b), if the outline thickness of the captured image is larger than the outline thickness of the latest preview image in the preview mode, correction for the shake of the captured image is performed.

Description

Method of controlling digital image processing apparatus wherein image shaking is corrected}

1 is a rear view showing a rear appearance of a digital camera as a digital image processing apparatus according to the present invention.

FIG. 2 is a diagram illustrating the overall configuration of the digital camera of FIG. 1.

3 is a flow chart showing the main algorithm of the digital camera processor of FIG.

4 is a flowchart illustrating an algorithm of performing a preview mode of FIG. 3.

5 is a flowchart illustrating an algorithm of performing a shooting mode of FIG. 3.

6 is a diagram conceptually illustrating a detailed algorithm of the shake correction step of FIG. 5.

7 is a flowchart illustrating a detailed algorithm of the shake correction step of FIG. 5.

<Explanation of symbols for the main parts of the drawings>

1 ... digital camera, 12 ... flash,

13 ... shutter release button, 14 ...

15 ... function buttons, 15 _R ... self-timer / right button,

15 _L ... flash / left button, 15 _D ... macro / down button,

15 _U ... Voice-Memo / Up Button, 15 _M ... Menu / Select-OK Button,

17b ... view finder, 21 ... external interface,

43 ... microphone, 45 ... speaker, 32 ... monitor button, 33 ... auto-focus lamp,

34 ... flash standby lamp, 35 ... color LCD panel,

36 ... Manual-Focusing / Delete button, 37 ... Manual-Adjusting / Play / Stop button,

39 _W ... wide-zoom button, 39 _T ... tele-zoom button,

OPS ... optical system, OEC ... photoelectric conversion unit,

M _Z ... zoom motor, M _F ... focus motor,

M _A ... aperture motor, 501 ... analog-to-digital converter,

502 timing circuit, 503 real time clock,

504 ... DRAM, 505 ... EEPROM,

506 memory card interface, 507 digital camera processor, 508 RS232C interface, 509 video filter,

21a ... USB connection, 21b ... RS232C connection,

21c ... video output, 510 ... lens drive,

511 ... flash controller, 512 ... microcontroller,

520 ... user input, 521 ... light-emitting unit,

513 audio processor, 514 LCD driver.

The present invention relates to a control method of a digital image processing apparatus, and more particularly, a preview mode for continuously displaying incident preview images, and a photographing operation when a photographing signal is generated from a user in the preview mode. A control method of a digital image processing apparatus having an imaging mode to be performed.

A conventional digital image processing apparatus, for example, a digital camera of 2004 United States Publication No. 119,876 (name of the invention: Method of notification of inadequate picture quality), which was patented by the applicant, is a file generated by a photographing operation. Image shake can be determined using the capacity of. Hereinafter, the image shake means that the outline of the image is thickly blurred due to the shake at the time of shooting.

SUMMARY OF THE INVENTION An object of the present invention is to provide a control method of a digital image processing apparatus capable of automatic shake correction as the shake of the captured image is determined before the file of the captured image is completed in the shooting mode.

To achieve the above object, the present invention provides a digital image processing apparatus including a preview mode for continuously displaying incident preview images, and a shooting mode for performing a shooting operation when a shooting signal is generated from the user in the preview mode. The control method of the method comprises steps (a) to (c).

In the step (a), in the photographing mode, an incident image is captured according to the photographing signal. In the step (b), first captured image data having the same resolution as the preview image is obtained from the captured image. In the step (c), if the contour thickness of the first captured image data is larger than the contour thickness of the preview image before the photographing signal is generated, performing the correction for the shaking of the captured image.

According to the control method of the digital image processing apparatus of the present invention, the file of the captured image is obtained by comparing the outline thickness of the captured image with the outline thickness of the preview image before the photographing signal is generated in the preview mode. The shaking of the captured image can be determined before completion. Accordingly, automatic shake correction is possible.

Hereinafter, preferred embodiments according to the present invention will be described in detail.

Referring to FIG. 1, the digital camera 1 as a digital image processing apparatus according to the present invention includes a shutter release button 13, a mode dial 14, a mode-indicating lamp 14 _L , function buttons 15, Manual-Focusing / Delete button (36), Manual-Adjustment / Play / Stop button (37), Playback mode button (42), Speaker (45), Monitor button (32), Auto-focus lamp (33), Viewfinder (17b), flash standby lamp 34, color LCD panel 35, wide angle-zoom button 39 _W , telephoto-zoom button 39 _T , and external interface There is 21.

The shutter release button 13 has a two-stage structure. That is, when the user operates the wide-angle zoom button 39 _W and the tele-zoom button 39 _T , and presses the shutter release button 13 only one step, the SH1 signal from the shutter release button 13 is turned on. And the second stage, the SH2 signal from the shutter release button 13 is turned on (see FIG. 5).

The mode dial 14 is any one of operation modes of the camera, for example, a simple shooting mode, a program shooting mode, a portrait shooting mode, a night view shooting mode, a manual shooting mode, a movie shooting mode, a personal loading mode, and a recording mode. Used to select the operating mode by the user.

For reference, the personal loading mode refers to an operation mode used in the shooting mode by loading the personal shooting conditions of the user stored in the memory card as the recording medium. Meanwhile, the recording mode refers to an operation mode for simply recording only a voice of a user, for example.

The function buttons 15 are used by the user to perform specific functions of the digital camera 1 while being used as direction-shift buttons and the like of the activation cursor in the menu screen of the color LCD panel 35. The function buttons 15 are self-timer / right button 15 _R , flash / left button 15 _L , macro / down button 15 _D , voice-memo / up button 15 _U , and menu / select - includes a confirmation button (15 _M).

Manual-adjust / play / stop button 37 is used for manual adjustment of certain conditions. In addition, in the playback mode, when the user presses the manual-adjustment / playback / stop button 37 while the user selects any video file, the selected video file can be played or stopped.

The manual focusing / deletion button 36 is used to manually focus or delete operation by the user in the shooting mode.

The monitor button 32 is used by the user to control the operation of the color LCD panel 35.

The playback mode button 42 is used for switching to the playback or preview mode.

The auto-focus lamp 33 operates when the focus is well achieved. The flash standby lamp 34 operates when the flash 12 (in FIG. 2) is in an operation standby state. Mode refers to the selection mode of the indicator lamps (14 _L), a mode dial 14.

FIG. 2 shows the overall configuration of the digital camera 1 of FIG. 1. 1 and 2, the overall configuration and operation of the digital camera 1 of FIG. 1 will be described.

The optical system OPS including the lens unit and the filter unit optically processes light from a subject.

The lens unit of the optical system OPS includes a zoom lens, a focus lens, and a compensation lens.

When the user presses the wide angle zoom button 39w or the telephoto zoom button 39t included in the user input unit 520, a corresponding signal is input to the microcontroller 512. Accordingly, as the microcontroller 512 controls the driving unit 510, the zoom motor M _Z is driven to move the zoom lens.

Meanwhile, in the auto focus mode, the focus motor M _F is driven by the main controller embedded in the digital camera processor 507 controlling the lens driver 510 through the microcontroller 512. As a result, the focus lens is moved, and in this process, the position of the focus lens where the high frequency component of the image signal is the largest, for example, the number of driving steps of the focus motor M _F is set.

The compensating lens of the lens unit of the optical system OPS is not driven separately because it serves to compensate the overall refractive index. Reference numeral M _A denotes a motor for driving an aperture (not shown).

A photoelectric conversion unit (OEC) of a charge coupled device (CCD) or a complementary metal-oxide-se43onductor (CMOS) converts light from an optical system (OPS) into an electrical analog signal. Here, the digital camera processor 507 controls the timing circuit 502 to control the operation of the photoelectric converter OEC and the Correlation Double Sampler and Analog-to-Digital Converter (CDS-ADC) element 501. The CDS-ADC element 501 processes the analog signal from the photoelectric conversion unit OEC, removes the high frequency noise, adjusts the amplitude, and converts it into a digital signal.

The real time clock 503 provides time information to the digital camera processor 507. The digital camera processor 507 processes the digital signal from the CDS-ADC element 501 to generate a digital video signal classified into luminance and chroma signals.

In the light emitting portion 521 driven by the microcontroller 512 according to control signals from the digital camera processor 507 incorporating the main controller, a self-timer lamp (not shown), an auto-focus lamp 33 ), A mode indication lamp 14 _L and a flash standby lamp 34 are included. The user input unit 520 has a shutter release button 13, a mode dial 14, function buttons 15, a monitor button 32, a manual-focusing / deleting button 36, a manual-adjusting / playback button ( 37), wide-zoom button 39 _W , telephoto-zoom button 39 _T , and the like.

In the DRAM (Dyna43 Random Access Memory) 504, a digital video signal from the digital camera processor 507 is temporarily stored. The EEPROM (Electrically Erasable and Programmable Read Only Memory) 505 stores algorithms and setting data necessary for the operation of the digital camera processor 507 as a controller. In the memory card interface 506, a memory card as a recording medium of a user is detached.

The digital image signal from the digital camera processor 507 is input to the LCD driver 514, whereby the image is displayed on the color LCD panel 35.

On the other hand, the digital video signal from the digital camera processor 507 can be transmitted by serial communication via the USB (Universal Serial Bus) connection 21a or the RS232C interface 508 and its connection 21b, and the video filter ( 509 and the video output unit 21c may be transmitted as a video signal.

The audio processor 513 outputs the audio signal from the microphone 43 to the digital camera processor 507 or the speaker 45, and outputs the audio signal from the digital camera processor 507 to the speaker 45.

On the other hand, the microcontroller 512 drives the flash 12 by controlling the operation of the flash controller 511 according to the signal from the flash-light amount sensor 19.

A main algorithm of the digital camera processor 507 of FIG. 2 will be described with reference to FIGS. 1 to 3 as follows.

When operating power is applied to the digital camera 1, the digital camera processor 507 executes initialization (step S1). When this initialization step S1 is executed, the digital camera processor 507 performs a preview mode (step S2). In this preview mode, the input image is displayed on the display panel 35. Operations associated with this preview mode will be described in more detail with reference to FIG. 4.

Next, when the SH1 signal from the shutter release button 13 is turned on (step S3) as the user presses the shutter release button 13 only one step, the digital camera processor 507 changes the current shooting mode. (Step S4). An algorithm for performing the shooting mode (step S4) will be described with reference to FIG.

Next, when signals corresponding to the setting mode are input among the input signals from the user input unit 520 (step S5), a setting mode for setting operating conditions according to the input signals from the user input unit 520 is performed. (Step S6).

In addition, if no end signal is generated, the digital camera processor 507 continues the following steps (step S7).

First, when a signal is generated from the playback mode button 42 in the user input unit 520 (step S8), the digital camera processor 507 performs the playback mode (step S9). In the reproduction mode, the reproduction operation is performed according to the input signals from the user input unit 520. If a signal is generated from the regeneration mode button 42 while the regeneration mode is being performed, performance of the regeneration mode is terminated, and the above steps S2 and subsequent steps are repeatedly performed.

1, 2 and 4, the algorithm of performing the preview mode (step S2) of FIG. 3 will be described.

First, the digital camera processor 507 performs an automatic white balance (AWB) operation to set parameters related to the white balance (step S201).

Next, an automatic exposure (AE) operation is performed (step S202). Here, the digital camera processor 507 calculates the exposure amount with respect to the incident brightness, drives the aperture driving motor M _A according to the calculated exposure amount, and sets the exposure time. Next, an automatic focusing (AF) operation is performed (step S203).

Next, the digital camera processor 507 performs gamma correction on the input image data (step S204), and performs scaling on the input image data on which the gamma correction is performed to meet the display standard. (Step S205).

Next, the digital camera processor 507 converts the format of the scaled input image data from the format of red (R)-green (G)-blue (B) to the format of luminance-chroma (step S206). . Next, the digital camera processor 507 processes the input image data in relation to the resolution, the display position, and the like and performs filtering (step S207).

Next, the digital camera processor 507 temporarily stores the input video data in the dynamic RAM (504 in FIG. 3) (step S208).

Next, the digital camera processor 507 synthesizes the data temporarily stored in the dynamic RAM (504 of FIG. 3) and the On-Screen Di45lay data (step S209). Next, the digital camera processor 507 converts the format of the synthesized image data from the format of luminance-chromaticity to the format of red (R) -green (G) -blue (B) (step S210). The video data of the format is output to the LCD driver 514 of FIG. 3 (step S211).

5 shows an algorithm of performing the shooting mode (step S4) of FIG. 1, 2, and 5, the algorithm of performing the shooting mode (S4) of Figure 3 will be described as follows. Here, the current position of the zoom lens is already set.

First, the digital camera processor 507 checks the remaining amount of the memory card (step S401) to confirm whether it is a capacity capable of storing the digital video signal (step S402). If it is not a storage capacity, the digital camera processor 507 indicates that the capacity of the memory card is insufficient, and then ends execution of the shooting mode (S41) (step S403). In case of storage capacity, the following steps are performed.

First, the digital camera processor 507 sets white parameters related to white balance by performing white balance setting according to currently set shooting conditions (step S404).

Next, in the automatic exposure (AE) mode (step S4105), the digital camera processor 507 calculates the exposure amount with respect to the incident brightness, and drives the aperture driving motor M _A in accordance with the calculated exposure amount. An exposure time is set (step S406).

Next, in the automatic focusing mode (step S407), the digital camera processor 507 performs auto focusing to drive the focus lens (step S408).

Next, the digital camera processor 507 continues the following steps if the one-stage signal SH1 from the shutter release button 13 is on (step S409).

First, the digital camera processor 507 checks whether the two-stage signal SH2 signal from the shutter release button 13 is on (step S410). If the two-stage signal SH2 is not on, the digital camera processor 507 repeats the above steps S405 to S410 because the user has not pressed the second stage of the shutter release button 13 for shooting. Perform.

If the two-stage signal SH2 is on, the user presses the second stage of the shutter release button 13 for shooting, and therefore the digital camera processor 507 generates an image file on a memory card as a storage medium. (Step S411). The digital camera processor 507 then performs image capture (step S412). That is, the digital camera processor 507 receives the still image data from the CDS-ADC element 501.

Next, the digital camera processor 507 performs shake correction. In this shake correction step (S413), if the outline thickness of the captured image is larger than the outline thickness of the recent preview image in the preview mode (S2 of FIGS. 3 and 4), correction for the shake of the captured image is performed. do. Here, by comparing the contour thickness of the captured image with the contour thickness of the recent preview image in the preview mode, the shake of the captured image can be determined before the file of the captured image is completed. Accordingly, automatic shake correction is possible. This shake correction step S413 will be described in detail with reference to FIGS. 6 and 7.

Next, the digital camera processor 507 compresses the received image data (step S414). The digital camera processor 507 completes the video file by storing the compressed video data in the video file (step S415).

6 and 7, the detailed algorithm of the shake correction step S413 of FIG. 5 will be described.

First, the digital camera processor 507 extracts the luminance Y data D _YP , 63 or the green G data D _GP , 63 from the data 61 of the latest preview image (step S701). Next, the digital camera processor 507 performs high frequency filtering (HPF) on the extracted luminance (Y) data (D _YP , 63) or green (G) data (D _GP , 63), thereby performing preview contour data ( 65) (step S702). For reference, in the high frequency filtering (HPF), the frequency means a gray level difference between adjacent pixels. The reason why the high frequency filtering (HPF) is performed only on the luminance (Y) data (D _YP , 63) or the green (G) data (D _GP , 63) is to increase the speed of the high frequency filtering (HPF). to be.

Similarly, the digital camera processor 507 extracts the luminance Y data D _YC 64 or the green G data D _GC 64 from the data 62 of the captured image (step S703). Next, the digital camera processor 507 performs a first capture contour by performing high frequency filtering (HPF) on the extracted luminance (Y) data (D _YC , 64) or green (G) data (D _GC , 64). Data 66 is acquired (step S704).

In general, the resolution of the preview image in the preview mode (S2 of FIGS. 3 and 4) is lower than the resolution of the image captured in the shooting mode (S4 of FIGS. 3 and 5). Therefore, the resolution of the first captured outline data 66 is higher than the resolution of the preview outline data 65. Accordingly, the digital camera processor 507 obtains second capture outline data 67 having the same resolution as the preview outline data 65 from the first capture outline data 66 (step S705).

Next, the digital camera processor 507 compares the outline thickness of the preview image with the outline thickness of the captured image (step S706). More specifically, the digital camera processor 507 is the pixel number (N _P) to form a preview preview contour outline data 65 robu emitter is obtained. The digital camera processor 507 also obtains the number N _{C of} pixels forming the capture contour from the second capture contour data 67. Then, the digital camera processor 507 is a result of subtracting the pixel number (N _P) to form a contour on the preview pixel number (N _C) to form the capture contour (68, N _C -N _P) is the first predetermined number It is determined whether it is larger than (α1).

Next, the digital camera processor 507 determines that the captured image is shaken if the subtraction result 68 (N _C -N _P ) is greater than the first set number α1, and the subtraction result 68, N _C. It is determined whether -N _P is larger than the second set number α2 (step S707).

Next, the digital camera processor 507 determines the first capture contour if the subtraction result 68, N _C -N _P is greater than the first set number α1 and not greater than a second set number α2. Compensation for the shaking of the captured image is performed by combining data 66 with the data 62 of the captured image (step S708). Here, the sharpness of the correction contour of the captured image is determined according to the set cutoff frequency in the high frequency filtering (HPF) steps S702 and S703.

Next, the digital camera processor 507 determines that the data 62 of the captured image is severely shaken when the subtraction result 68 (N _C -N _P ) is larger than the second set number α2. It is determined whether the set shutter release time is an upper limit time, for example, 1/30 second or less (step S709). Typically, the shutter-release time is also called the shutter speed.

If the set shutter-release time is an upper limit time, for example, 1/30 seconds or less, the digital camera processor 507 determines that re-capture of a shake-free image is possible, and captures the incident image again to capture the captured image. Correction of image shake is performed (step S710).

If the set shutter-release time exceeds the upper limit time, for example, 1/30 second, the digital camera processor 507 determines that it is impossible to recapture the shake-free image, and outputs a guidance message accordingly (step S711). ).

As described above, according to the control method of the digital image processing apparatus according to the present invention, by comparing the contour thickness of the captured image with the contour thickness of the latest preview image in the preview mode, the file of the captured image is obtained. The shaking of the captured image can be determined before completion. Accordingly, automatic shake correction is possible.

The present invention is not limited to the above embodiments, but may be modified and improved by those skilled in the art within the spirit and scope of the invention as defined in the claims.

Claims (8)

A control method of a digital image processing apparatus having a preview mode for continuously displaying incident preview images and a photographing mode for performing a photographing operation when a photographing signal is generated from a user in the preview mode. (a) in the photographing mode, capturing an incident image according to the photographing signal; (b) acquiring first captured image data having the same resolution as the preview image from the captured image; And and (c) if the contour thickness of the first captured image data is larger than the contour thickness of the preview image before the photographing signal is generated, performing correction for shaking of the captured image. Way. The method of claim 1, wherein step (c) comprises (c1) obtaining preview contour data from data of a preview image before the photographing signal is generated; (c2) acquiring first captured contour data from the first captured image data; (c3) obtaining the number of pixels forming the preview contour from the preview contour data; (c4) obtaining the number of pixels forming the capture contour from the first capture contour data; And and (c5) if the number of pixels forming the capture contour is larger than the number of pixels forming the preview contour, performing correction for shaking of the captured image. The method of claim 2, wherein in step (c1), And the preview contour data is obtained by performing high frequency filtering on any one of luminance (Y) data and green (G) data of the preview image. The method of claim 3, wherein in step (c2), And the first captured contour data is obtained by performing high frequency filtering on any one of luminance (Y) data and green (G) data of the captured image. delete The method of claim 2, wherein in step (c5), And if a result of subtracting the number of pixels forming the preview contour from the number of pixels forming the capture contour is greater than a first set number, correction of the shaking of the captured image is performed. The method of claim 6, wherein in step (c5), If the result of subtracting the number of pixels forming the preview contour from the number of pixels forming the capture contour is greater than the first set number and not greater than the second set number, the first captured outline data is included in the captured image data. And a correction for the shaking of the captured image by performing the synthesis. The method of claim 7, wherein in step (c5), If the result of subtracting the number of pixels forming the preview contour from the number of pixels forming the capture contour is greater than the second set number, correction of the shaking of the captured image is performed by recapturing the incident image. Control method of digital image processing device.

Images