KR101340035B1 - Method for composite image in digital image processing device - Google Patents

Abstract

The present invention relates to a method of operating a digital image processing apparatus, and more particularly, to an image synthesizing method of a digital image processing apparatus capable of providing various motion blur effects using an optical image stabilization function and a zoom function. The image synthesis method of the digital image processing apparatus generates a first image and a motion blur-processed second image by receiving a single image capture signal, and then synthesizes and stores the first image and the second image. It features.

Description

Method for composite image in digital image processing device

1 is a perspective view showing the front and the top of the digital image processing apparatus.

FIG. 2 is a rear view illustrating a rear shape of the digital image processing apparatus of FIG. 1.

3 is a block diagram showing the configuration of a digital image processing apparatus.

4 is a flowchart illustrating an image synthesizing method of a digital image processing apparatus according to the present invention.

5 is a diagram illustrating a hand shake effect by the image synthesis of FIG. 4.

FIG. 6 is a diagram illustrating a zooming effect by the image synthesis of FIG. 4.

The present invention relates to a method of operating a digital image processing apparatus, and more particularly, to an image synthesizing method of a digital image processing apparatus capable of providing various motion blur effects using an optical image stabilization function and a zoom function.

The image taken by the photographer holding the digital image processing apparatus by hand generates small tremors, that is, hand shake. In recent years, since cameras are becoming higher in magnification and higher pixels, camera shake becomes more severe than before, and the number of images taken while moving is becoming an important factor in obtaining a clear image. Accordingly, a general digital image processing apparatus employs an optical image stabilization method that compensates for hand shake by moving an optical axis of a lens, or an electronic image stabilization method that detects hand shake from a captured image and corrects it. .

In addition, the digital image processing device uses a zoom lens to change the focal length during exposure with a slow shutter so that the size of the subject changes within the screen, and the zoom function can be used to spread the image around the center of the screen. Equipped.

As the desire of the user increases, various types of images may be obtained by deliberately giving a hand shake or zooming while the shutter is opened to give an effect such as panning and zooming in when the image is captured by the digital image processing apparatus. However, since these various types of images are manually photographed by user setting, it is difficult to obtain images of desired effects.

The technical problem to be achieved by the present invention is to generate a normal image and a motion blur processed image with a single shutter input, and to synthesize the two images to generate a video having a variety of effects image synthesis method To provide.

The image synthesizing method of the digital image processing apparatus for solving the technical problem to be achieved by the present invention is an operation method of the digital image processing apparatus, (a) when the image photographing signal is received, to generate the first normal photographed image step; (b) generating a second image subjected to motion blur when the image photographing signal is received; And (c) synthesizing and storing the first image and the second image.

In the present invention, when the image is synthesized in the step (c), the sum of the exposure gain of the first image and the exposure gain of the second image may be processed to have a constant value.

In the present invention, the exposure gain values of the first and second images set by the user may be received and reflected at the time of image synthesis.

The second image may be a shake processing image generated by receiving the image photographing signal.

The second image may be a zooming processed image generated by receiving the image photographing signal.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a perspective view showing the front and top appearance of a digital image processing apparatus as an image reproducing apparatus.

Referring to FIG. 1, there is a shutter-release button 11, a power button 13, a flash 15, an auxiliary light 17, and a lens unit 19.

The shutter-release button 11 is opened and closed to expose the CCD or film to light for a predetermined time, and the image is recorded on the CCD by properly exposing the subject in cooperation with the aperture (not shown).

The shutter release button 11 generates the first and second image capturing signals by a photographer input. When the first shutter release button 11 as a half shutter signal is input, the digital image processing apparatus focuses and adjusts the amount of light, and when the focus is achieved, the green light is turned on in the display unit 25. . When focus is achieved by the input of the first shutter release button 11 and the amount of light is adjusted, the second shutter release button 11 as a full shutter signal is input to capture an image.

The power button 13 is input to supply power to and operate the digital image processing apparatus.

The flash 15 brightens the bright light instantly when shooting in a dark place. Flash modes include auto flash, forced flash, flash off, red-eye reduction, and slow synchro.

The auxiliary light 17 supplies light to the subject so that the digital image processing apparatus automatically focuses quickly and accurately when the amount of light is insufficient or at night.

The lens unit 19 receives light from an external light source and processes an image.

FIG. 2 is a rear view illustrating a rear shape of the digital image processing apparatus of FIG. 1.

Referring to FIG. 2, a wide angle zoom button 21w, a telephoto zoom button 21t, a function button 23, and a display unit 25 are provided at the rear of the digital image processing apparatus. There is.

The wide-angle zoom button 21w or the tele-zoom button 21t increases the angle of view or narrows the angle of view depending on the input, particularly when the size of the selected exposure area is to be changed. When the wide-zoom button 21w is input, the size of the selected exposure area is reduced, and when the tele-zoom button 21t is input, the size of the selected exposure area is increased.

The function button 23 includes a total of five buttons including an up button, a down button, a left button, a right button, and a menu / OK button. The function button 23 is input to execute various menus related to the operation of the digital image processing apparatus, and each of the keys may be used as a shortcut key.

3 is a block diagram showing the configuration of the digital image processing apparatus shown in FIGS. 1 and 2, wherein the display unit 25, the user input unit 31, the imaging unit 33, the image processing unit 35, and the storage unit ( 37) and a control unit 39.

1 and 2, the user input unit 31 may include a shutter-release button 11 that opens and closes to expose a CCD or a film to light for a predetermined time, and a power button for turning on / off an operation of a digital image processing apparatus. (13) An input for executing a wide angle-zoom button 21w or a tele-zoom button 21t and various menus relating to the operation of the digital image processing apparatus to widen the angle of view or narrow the angle of view according to the input. There is a function button 23.

The imaging unit 33 includes a shutter-release button 11, a lens unit not shown in the figure, an aperture, a charge coupled device (CCD), and an ADC.

The shutter-release button 11 is a mechanism for adjusting the amount of light exposed with the aperture stop. The lens unit receives light from an external light source and processes the image. At this time, the iris adjusts the amount of light incident (light quantity) according to the degree of opening and closing. The opening and closing degree of the iris is controlled by the control unit 39.

The CCD accumulates the amount of light input through the lens unit and outputs the image captured by the lens unit according to the accumulated light amount in accordance with the vertical synchronization signal. Image acquisition of the digital image processing apparatus is performed by a CCD that converts light reflected from a subject into an electrical signal. In order to obtain a color image using a CCD, a color filter is required, and most of them employ a filter (not shown) called a color filter array (CFA). CFA has a regularly arranged structure that passes only light that represents one color per pixel, and it has various forms according to the arrangement structure. The ADC converts the analog video signal output from the CCD into a digital signal.

The image processor 35 performs signal processing to display a digitally converted image signal. Devices used in CCD and CFA filters are sensitive to a change in temperature and generate a dark current according to the changing temperature, which includes an unwanted black level in the image signal. The image processor 35 removes the black level generated by the dark current in this way.

The image processor 35 also performs gamma correction. Since human vision reacts nonlinearly to brightness according to Weber's law, when a given bit depth is given, linearly recording the brightness of the light will cause posterization. This happens. Therefore, in order to show the maximum image quality under a given bit depth, it is necessary to encode using a nonlinear function. As described above, encoding information in accordance with nonlinearity of human vision is referred to as gamma correction. The gamma correction of the image processor 35 gamma corrects and outputs an image signal input by the gamma curve. For example, the input luminance level of a 12 bit image signal is corrected to an 8 bit luminance level and output.

The image processor 35 performs CFA interpolation to interpolate the Bayer pattern implemented by the RGRG line and the GBGB line of the gamma corrected predetermined data into the RGB line. The CFA interpolation of the image processing unit 35 first restores the G channel from the pixels having only the R or B channel value, and then fills the empty values in the order of the B channel, the R channel, or the R channel, the B channel, to R, G. , B restores three channels.

The image processing unit 35 converts the interpolated RGB signal into a YUV signal and filters the Y signal by a high band filter to clearly process the image, and uses the standard color coordinate system to adjust the color values of the U and V signals. Perform color correction to correct and remove their noise.

The image processor 35 generates an Exif file by compressing and signal-processing Y, U, and V signals from which noise is removed, and the generated Exif file is displayed on the display unit 25 and stored in the storage unit 37. .

All of the operations of the image processor 35 operate under the control of the controller 39.

The controller 39 provides a motion blur menu to implement a motion blur effect on the captured image, and provides a shake effect menu and a zooming menu as a sub menu of the motion blur menu.

When the control unit 39 receives the selection signal from the shake effect menu from the user, the control unit 39 receives a single shutter-release button 11 input signal to control a normal photographed image to be generated, and then the shake image is processed to generate the photographed image. Control as possible. Subsequently, the controller 39 synthesizes the normal photographed image and the image of the hand shake process to generate the final image of the hand shake effect.

When the control unit 39 receives the selection signal of the zooming effect menu from the user, the control unit 39 receives a single shutter-release button 11 input signal to control a normal photographed image to be generated, and generates a zoomed image. Control as possible. Thereafter, the controller 39 synthesizes the general photographed image and the zoomed image to generate a final zooming effect image.

Hereinafter, an image synthesis method of the digital image processing apparatus according to the present invention will be described in detail with reference to FIGS. 4 to 6. The image synthesizing method of the digital image processing apparatus according to the present invention may be performed inside the digital image processing apparatus as shown in FIG. 3. It can be performed inside the control unit 39.

The controller 39 determines whether a motion blur menu is selected from the user (step 401). When the motion blur menu is selected, the display unit 25 displays a shake effect menu and a zooming menu as a sub menu.

The controller 39 determines whether the camera shake effect menu is selected from the sub-menu displayed on the display 25 (step 402).

When the camera shake effect menu is selected from the sub-menu displayed on the display unit 25, the user composes a desired subject and inputs the shutter-release button 11 to take an image (step 403).

 When an image is captured by the input of the shutter-release button 11, the controller 39 generates a first photographed image in general (404). The controller 39 controls the image capturing unit 33 and the image processing unit 35 to generate the first captured image as shown in FIG. 5A.

Subsequently, the controller 39 receives the shutter-release button 11 input to generate a second image captured by the camera shake process (step 405). In the present invention, the first image and the second image are continuously photographed by the input of one shutter-release button 11. In the present invention, the optical or electronic camera shake method described above may be reversely used to generate the second image which is subjected to the camera shake process.

In the optical image stabilization method, a sensor (not shown) in the imaging unit 33 detects vibration before an image is displayed on the screen, and moves the lens (not shown) in the up, down, left, right, and diagonal directions in the opposite direction to the vibration. In order to generate a second image which is artificially shake processed as in the present invention, the lens is moved in the up, down, left, right and diagonal directions irrespective of the direction in which vibration is generated to perform the hand shake process.

The electronic image stabilization method is a method in which a CCD receives an image of a hand shake as it is, and the program electronically adjusts the position and color to produce an image with no shaking. 2 To create an image, the program electronically adjusts the position, color, etc., to produce an image with tremor.

By using the optical image stabilization method as described above, a second image is generated by artificially performing a camera shake process. As described above, the controller 39 controls the image capturing unit 33 and the image processing unit 35 to generate a second image which is shaken as shown in FIG. 5B.

When the generation of the first image and the second image is completed as described above, the controller 39 synthesizes the normal image of the first image and the second image processed by shaking (step 406). The controller 39 adjusts the exposure gains of the first image and the second image to maintain the same exposure level during the synthesis of the first image and the second image. When the exposure gain of the first image and the exposure gain of the second image are synthesized, the exposure gain of the image generated as a result of the synthesis is increased, so that the exposure gain of the first image is remarkably generated, that is, brighter. Therefore, the controller 39 adjusts the gain of the first image and the exposure gain of the second image such that the sum of the gain of the first exposure image and the exposure gain of the second image is a constant value (for example, 1). For example, if the exposure gain of the first image is adjusted to 1/3 of the previously set exposure gain, and the exposure gain of the second image is adjusted to 2/3 of the previously set exposure gain, the synthesis result 1 is obtained. Such exposure gain adjustment is performed by the controller 39, and user setting is possible. FIG. 5C shows a result of adjusting and synthesizing the exposures of the first image captured in general and the second image processed in shake.

If the shake effect menu is not selected by the user, the controller 39 determines whether the zooming effect menu is selected from the submenu displayed on the display unit 25 (step 407).

When the zooming effect menu is selected from the sub-menu displayed on the display unit 25, the user composes a desired subject and inputs the shutter-release button 11 to take an image (step 408).

 When the image is captured by the input of the shutter-release button 11, the controller 39 generates the first captured general image in step 409. The controller 39 controls the image capturing unit 33 and the image processing unit 35 to generate a first general image photographed as shown in FIG. 6A.

Subsequently, the controller 39 receives the input of the shutter-release button 11 to generate a second image captured by zooming (operation 410). In the present invention, an electronic zoom function is used to generate a zoomed second image. Zooming utilizes the characteristics of a zoom lens (not shown) in the imaging unit 33. The zoom lens is a lens that can change the focal length of the lens within a certain range while the focus is fixed. At this time, as the focal length is changed, the image size is also changed along with the angle of view. When the focal length is changed during exposure using a slow shutter using such a zoom lens, the size of the subject changes within the screen and the image is spread out around the center of the screen. As described above, the control unit 39 controls the image capturing unit 33 and the image processing unit 35 to generate a second image that is zoomed out as shown in FIG.

When the generation of the first image and the second image is completed as described above, the controller 39 synthesizes the first photographed general image and the second zoomed image in step 406. The controller 39 adjusts the exposure gains of the first image and the second image to maintain the same exposure level during the synthesis of the first image and the second image. Exposure gain adjustment is omitted since it is disclosed above. Such exposure gain adjustment is performed by the controller 39, and user setting is possible. FIG. 6C shows a result of adjusting and synthesizing the exposures of the first captured image and the second zoomed image.

If the jitter effect menu or the zooming effect menu is not selected from the sub-menu displayed on the display unit 25, the user composes a desired subject and inputs the shutter-release button 11 to take a general image (step 412).

The controller 39 controls the image processor 35 to generate a JPEG image file of the general image, the shake image, and the zoomed image, which are captured above, to be displayed on the display unit 25 and to the storage unit 37. Save (step 413).

As described above, according to the present invention, a single shutter input generates a general image and a motion blur processed image such as camera shake or zooming, and may combine the two images to generate images of various effects, thereby satisfying the user. It will be possible to improve.

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (5)

As an operation method of the digital image processing apparatus, (a) generating a general photographed first image when an image photographing signal is received; (b) generating a second image subjected to motion blur when the image photographing signal is received; And (c) a method of operating a digital image processing apparatus comprising synthesizing and storing the first image and the second image, The second image subjected to the motion blur is, Regardless of the direction of vibration, images taken while moving the lens in up, down, left, right and diagonal directions, The program electronically adjusts the position and color, etc. A method of operating a digital image processing apparatus, wherein the zoom lens is operated to change a focal length during exposure with a slow shutter. The method of claim 1, wherein in the step (c) of the image synthesis, And the sum of the exposure gain of the first image and the exposure gain of the second image is processed to have a constant value. 3. The method of claim 2, And receiving and reflecting the exposure gain values of the first and second images set by a user and reflecting them when the image is synthesized. The method of claim 1, wherein the second image is And a camera shake processing image generated by the reception of the image capturing signal. The method of claim 1, wherein the second image And a zooming processed image generated by receiving the image capturing signal.

Images