KR101411310B1 - Apparatus and method for compositing image in digital image device - Google Patents

Abstract

The present invention relates to a digital image processing apparatus and an operation method thereof, and more particularly, to a digital image processing apparatus and a digital image processing method, which are capable of synthesizing a second image photographed on a photographed first image and synthesizing the photographed image, And an image synthesizing apparatus and method in an image processor. A digital image processor in a digital image processor is a digital image processor for capturing and storing first and second images and for reducing the size of arbitrarily selected sub-images among the first and second images, Processing means.

The first image, the second image, the second image reduction, the first image reduction, the first and second image synthesis

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital image processing apparatus,

The present invention relates to a digital image processing apparatus and an operation method thereof, and more particularly, to a digital image processing apparatus and a digital image processing method, which are capable of synthesizing a second image photographed on a photographed first image and synthesizing the photographed image, And an image synthesizing apparatus and method in an image processor.

In general, when a user wants to input information about the image after shooting the image, he or she may insert a memo or the like, or may separate the images into various categories when storing the files.

However, if the information of the photographed image can be known only by synthesizing the photographed images, it is possible to provide convenience to the user.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is an object of the present invention to provide an image synthesizing apparatus and method in a digital image processor for synthesizing a second image photographed on a photographed first image, .

According to a first aspect of the present invention, there is provided a digital image processor for capturing and storing first and second images, And a digital signal processing means for reducing the size of the sub-image and synthesizing the sub-image with the main image.

In the present invention, when the sub image is selected from the displayed composite image, the digital signal processing unit enlarges the size of the sub image to the size of the main image, and reduces the size of the main image to the size of the sub image .

According to a second aspect of the present invention, there is provided a digital image processor for selecting a stored first and second images, and for selecting arbitrarily selected sub-images among the first and second images, And a digital signal processing means for reducing the size of the main image and synthesizing it with the main image.

In the present invention, when the sub image is selected from the displayed composite image, the digital signal processing unit enlarges the size of the sub image to the size of the main image, and reduces the size of the main image to the size of the sub image .

According to a first aspect of the present invention, there is provided a method of operating a digital image processor, the method comprising: (a) capturing and storing a first image; (b) photographing and storing the next second image; And (c) reducing the size of the sub-image selected arbitrarily among the first and second images and synthesizing the sub-image with the main image.

In the present invention, when the sub image is selected in the displayed composite image, the size of the sub image may be enlarged to the size of the main image, and the size of the main image may be reduced to the size of the sub image.

According to a second aspect of the present invention, there is provided a method of operating a digital image processor, the method comprising: (a) selecting a stored first image; (b) selecting a stored second image; And (c) reducing the size of the sub-image selected arbitrarily among the first and second images and synthesizing the sub-image with the main image.

In the present invention, when the sub image is selected in the displayed composite image, the size of the sub image may be enlarged to the size of the main image, and the size of the main image may be reduced to the size of the sub image.

As described above, according to the present invention, the second image photographed on the photographed first image can be synthesized in a small size, and information of the photographed image can be known only by synthesizing the photographed image, thereby providing convenience to the user.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a perspective view showing the front and top contours of a digital image processor.

The shutter-release button 11 is opened and closed to expose the CCD or film to light for a predetermined time, and the image is recorded on the CCD by appropriately exposing the subject in cooperation with the aperture (not shown).

The shutter-release button 11 generates the first and second image pickup signals by the photographer input. When the first shutter-release button 11 is input as a half-shutter signal, the digital image processing apparatus focuses and adjusts the amount of light. At this time, the display unit 25 is lit with a green light . When the focus of the first shutter-release button 11 is focused and the amount of light is adjusted, a second shutter-release button 11 as a full shutter signal is input to capture an image.

The power button 13 is inputted to supply power to the digital image processing apparatus and operate it.

The flash 15 illuminates bright light momentarily when shooting in a dark place. The flash mode includes auto flash, forced flash, no flash, red-eye reduction, and slow synchro flash.

The auxiliary light 17 supplies light to the subject so that the digital image processing apparatus automatically catches the focus quickly and accurately when the light amount is insufficient or at night.

The lens unit 19 receives light from an external light source and processes the image.

FIG. 2 is a rear view showing the rear external appearance of the digital image processor shown in FIG. 1. The wide-angle zoom button 21w, the telephoto-zoom button 21t, the display unit 23, Input buttons B1 to B14 (hereinafter referred to as buttons B1 to B14).

The wide-angle zoom button 21w or the telephoto-zoom button 21t widens the view angle or narrows the view angle depending on the input, in particular, when the size of the selected exposure area is to be changed. When the wide angle-zoom button 21w is input, the size of the selected exposure area is reduced, and when the telephoto-zoom button 21t is input, the size of the selected exposure area is increased.

The buttons B1 to B14 are provided in the rows and columns of the display unit 23. The buttons B1 to B14 provided in the row and column of the display unit 23 are provided with a touch sensor (not shown) or a contact type switch (not shown).

That is, the touch sensors are provided on the buttons B1 to B14 to move up / down / left / right while touching the buttons B1 to B7 of the horizontal row or the buttons B8 to B14 of the vertical row, It is possible to select any value (e.g., color or brightness) of the items, or activate a submenu icon included in the main menu icon.

In addition, the button frames (B1 to B14) are provided with contact switches so that the main menu icon and the sub menu icon can be directly selected to execute the corresponding function. The touch sensor requires a relatively weak touch compared to the contact switch input, but the contact switch input requires a relatively strong touch compared to the touch sensor input.

3 is a block diagram showing a configuration of an image synthesizing apparatus in a digital image processor according to the present invention. The display unit 23, the user input unit 31, the image pickup unit 33, the image processing unit 35, 37 and a digital signal processing unit 39. [

The user input unit 31 includes a shutter release button 11 that is opened and closed to expose a CCD or a film to light for a predetermined period of time, a power button 13 that inputs power to supply power, Zoom button 21w and telephoto-zoom button 21t for narrowing down the screen and a touch sensor or contact type switch provided in the horizontal and vertical columns around the display unit 23 for character input or menu selection and execution, And button buttons (B1 to B14).

The imaging section 33 includes a shutter, a lens section, a diaphragm, and a charge coupled device (CCD) and an ADC (not shown). The shutter is a mechanism that adjusts the amount of light that is exposed with the iris. The lens unit receives light from an external light source and processes the image. At this time, the diaphragm adjusts the amount (light amount) of the incident light according to the degree of opening and closing. The opening / closing degree of the diaphragm is controlled by the digital signal processing section 39. [

The CCD accumulates the amount of light input through the lens unit and outputs the image captured by the lens unit according to the accumulated light amount in accordance with the vertical synchronization signal. Image acquisition of a digital image processing apparatus is performed by a CCD which converts light reflected from a subject into an electrical signal. In order to obtain a color image using a CCD, a color filter is required, and a filter (not shown) called a color filter array (CFA) is employed in most cases. CFA has a regularly arranged structure that passes only light that represents one color per pixel, and it has various forms according to the arrangement structure. The ADC converts the analog video signal output from the CCD into a digital signal.

The image processing unit 35 processes the digitally converted RAW data so that it can be displayed. The image processing unit 35 removes a black level due to the dark current generated in the CCD and the CFA filter which are full of temperature change. The image processing unit 35 performs gamma correction to encode information in accordance with the nonlinearity of human vision. The image processing unit 35 performs CFA interpolation for interpolating a Bayer pattern implemented with RGA and RGB lines of gamma-corrected predetermined data into RGB lines. The image processing unit 35 converts the interpolated RGB signals into YUV signals, performs edge compensation for filtering the Y signals by a high-pass filter, and calculates color values of the U and V signals using a standard color coordinate system Corrects the color correction, and removes these noises. The image processing unit 35 compresses and processes the Y, U, and V signals from which the noise has been removed to generate a JPEG file, and the generated JPEG file is displayed on the display unit 23 and stored in the storage unit 37 . All the operations of the image processing unit 35 operate under the control of the digital signal processing unit 39. [

The digital signal processing unit 39 photographs the first and second images and stores them in the storage unit 37. At this time, the digital signal processor 39 may set the first image as a main image, the second image as a sub-image, the second image as a main image, and the first image as a sub-image. Then, the digital signal processor 39 reduces the size of the sub-image and synthesizes the sub-image with the main image, and stores the synthesized image in another folder of the storage unit 37 instead of the folder in which the first and second images are stored.

At this time, when the sub image is selected in the displayed composite image, the sub image is enlarged to the size of the main image, the main image is reduced to the size of the sub image, and is synthesized and stored in another folder of the display and storage unit 37 . In another embodiment, when a sub-image is selected in the displayed composite image, the digital signal processing unit 39 retrieves the first image stored in the storage unit 37 and reduces it to a sub-image size, 2 image to synthesize a first image as a sub-image on a second image as a main image, and then stores the synthesized first image in another folder of the display and storage unit 37.

As shown in FIG. 4, the digital signal processing unit 39 photographs the flower image (a) with the first image and stores it in the storage unit 37, captures the information image (b) (37). Here, the digital signal processing unit 39 can set the flower image a as a main image and the information image b as a sub image, and conversely, the information image b can be set as a main image, a) may be set as a sub-image. Then, the digital signal processor 39 generates the reduced image b-1 by reducing the size of the information image b, which is the second image as the sub-image, and generates the reduced image b- the first synthesized image c obtained by synthesizing the reduced information image b-1 in the first storage unit 37a is stored in another folder of the storage unit 37. [ Here, the other folder means a folder other than the folder in which the flower image (a) and the information image (b) are stored.

Upon receiving the information image (b-1) selection signal as a sub-image from the user in a state in which the first synthesized image (c) is displayed, the digital signal processing section 39 generates a first image A second composite image d obtained by reducing the size of the image a to generate a reduced image a-1 and synthesizing the reduced flower image a-1 on the information image b is stored in a storage unit 37).

In another embodiment, images already stored may be selectively reproduced and synthesized. In this case, the digital signal processing unit 39 selects the first and second images stored in the storage unit 37. The digital signal processing unit 39 may set the selected first image as a main image, the second image as a sub-image, the selected second image as a main image, and the first image as a sub-image. After that, the digital signal processor 39 reduces the size of the selected sub-image and combines the selected sub-image with the selected main image, and stores and displays the synthesized sub-image in another folder of the storage unit 37.

At this time, when the sub image is selected in the displayed composite image, the sub image is enlarged to the size of the main image, the main image is reduced to the size of the sub image, and is synthesized and stored in another folder of the display and storage unit 37 . In another embodiment, when a sub-image is selected in the displayed composite image, the digital signal processing unit 39 retrieves the first image stored in the storage unit 37 and reduces it to a sub-image size, 2 image to synthesize a first image as a sub-image on a second image as a main image, and then stores the synthesized first image in another folder of the display and storage unit 37.

4, the digital signal processing unit 39 selects the flower image (a) as the first image (main image) from the storage unit 37 and outputs the second image The information image b is selected. Then, the digital signal processing unit 39 generates a reduced image b-1 by reducing the size of the information image b, which is the second image, as a sub-image, and outputs the reduced image a- (C-1) obtained by synthesizing the reduced information image (b-1) in the second folder (37). Here, the other folder means a folder other than the folder in which the flower image (a) and the information image (b) are stored.

Upon receiving the information image (b-1) selection signal as a sub-image from the user in a state in which the first synthesized image (c) is displayed, the digital signal processing section 39 generates a first image A second composite image d obtained by reducing the size of the image a to generate a reduced image a-1 and synthesizing the reduced flower image a-1 on the information image b is stored in a storage unit 37).

Hereinafter, a method of image synthesis in the digital image processor according to the present invention will be described in detail with reference to FIG. 5 and FIG. The image synthesis method in the digital image processor according to the present invention can be performed in a digital image processing apparatus as shown in FIG. 3. According to an embodiment, the main algorithm of the operation method is a method And may be performed in the digital signal processing unit 39.

First, referring to FIG. 5, a method of capturing an image according to the first embodiment of the present invention and compositing the same will be described.

The user selects a general shooting mode in the digital image processor, and the digital signal processor 39 receives the digital image processor and switches the digital image processor to the normal shooting mode (step 501).

Thereafter, the user selects a PIP (picture in picture) photographing mode provided by the digital image processor, and the digital signal processor 39 switches the digital image processor to the PIP photographing mode (step 503). The digital signal processing unit 39 provides a PIP menu as a menu for performing image synthesis.

In the PIP photographing mode, when the first image (first image) is photographed, the digital signal processing unit 39 stores it in the storage unit 37 (step 505).

Subsequently, when the second image (second image) is photographed, the digital signal processing unit 39 stores it in the storage unit 37 (step 507).

The digital signal processing unit 39 may set the first image as a main image, the second image as a sub image, the second image as a main image, and the first image as a sub image. In the present embodiment, it is assumed that the first image is set as the main image and the second image is set as the sub-image.

When the storage of the first image and the second image is completed, the digital signal processor 39 reduces the size of the sub-image and synthesizes the sub-image with the main image, and stores the synthesized image in another folder (for example, PIP Folder) (step 509). Here, the PIP folder is an arbitrary folder created for storing the composite image. As shown in FIG. 4, the digital signal processing unit 39 photographs the flower image (a) with the first image and stores it in the storage unit 37, captures the information image (b) (37). Then, the digital signal processor 39 generates the reduced image b-1 by reducing the size of the information image b, which is the second image as the sub-image, and generates the reduced image b- the first synthesized image c obtained by synthesizing the reduced information image b-1 in the first storage unit 37a is stored in another folder of the storage unit 37. [ Here, the other folder refers to a folder other than the folder in which the flower image (a) and the information image (b) are stored.

The digital signal processing unit 39 determines whether the PIP mode is canceled in step 511 and whether the playback mode is selected in step 513. If the user selects the PIP playback mode, The processor is switched to the PIP playback mode (step 515).

In the PIP playback mode, the digital signal processing unit 39 displays an image as shown in FIG. 4C in which the sub image is synthesized with the main image stored in the storage unit 37 (step 517).

In step 519, the digital signal processor 39 determines whether the sub video is selected from the composite video. If the sub video is selected, the digital signal processor 39 reduces the size of the previous main video to the size of the sub video, And then stores the synthesized image in another folder (for example, a PIP folder) of the storage unit 37 (step 521). When the first composite image c is displayed as shown in FIG. 4 and the user receives the information image (b-1) selection signal as a sub-image, the digital signal processing unit 39 generates the previous main image 1 that is a first image of the flower image a and a reduced flower image a-1 that is a reduced image of the flower image a- (d) is stored in another folder of the storage unit 37.

The digital signal processing unit 39 receives the image output signal from the user to output the synthesized image, and outputs the synthesized image by connecting the digital image processor to an output device (not shown) in steps 523 and 525.

Next, a method of synthesizing stored images according to a second embodiment of the present invention will be described with reference to FIG.

The user selects a normal reproduction mode in the digital image processor, and the digital signal processing unit 39, which has received the selection, switches the digital image processor to the normal reproduction mode (step 601).

Thereafter, the user selects a picture in picture (PIP) playback mode provided by the digital image processor, and the digital signal processor 39 switches the digital video processor to the PIP playback mode (operation 603). The digital signal processing unit 39 provides a PIP menu as a menu for performing image synthesis.

In the PIP playback mode, the digital signal processing unit 39 extracts the first image (first image) selected by the user from the storage unit 37 (Step 605).

Then, the digital signal processing unit 39 extracts a second image (second image) selected by the user from the storage unit 37 (step 607).

The digital signal processing unit 39 may set the selected first image as a main image, the second image as a sub-image, the selected second image as a main image, and the first image as a sub-image. In the present embodiment, it is assumed that the first image is set as the main image and the second image is set as the sub-image.

When the extraction of the first image and the second image is completed, the digital signal processor 39 reduces the size of the sub-image and synthesizes the sub-image with the main image, and stores the synthesized image in another folder (for example, PIP Folder) and displays it (step 609). Here, the PIP folder is an arbitrary folder created for storing the composite image. 4, the digital signal processing unit 39 selects the flower image (a) from the storage unit 37 as the first image (main image), and the second image (B). Then, the digital signal processor 39 generates a reduced image b-1 by reducing the size of the information image b, which is a second image, as a sub-image, and generates a reduced image b- (C) synthesized with the reduced information image (b-1) is stored in another folder in the storage unit 37. [ Here, the other folder means a folder other than the folder in which the flower image (a) and the information image (b) are stored.

In step 611, the digital signal processor 39 determines whether the sub video is selected from the composite video. If the sub video is selected, the digital signal processor 39 reduces the size of the previous main video to the size of the sub video, Enlarged to the image size, synthesized, and the synthesized image is stored in another folder (for example, a PIP folder) of the storage unit 37 and displayed (step 613). When the first composite image c is displayed as shown in FIG. 4 and the user receives the information image (b-1) selection signal as a sub-image, the digital signal processing unit 39 generates the previous main image 1 that is a first image of the flower image a and a reduced flower image a-1 that is a reduced image of the flower image a- (d) is stored in another folder of the storage unit 37.

The digital signal processing unit 39 receives the image output signal from the user to output the synthesized image, and outputs the synthesized image by connecting the digital image processor to an output device (not shown) in steps 615 and 617.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a perspective view showing the front and top contours of a digital image processor.

FIG. 2 is a rear view showing the rear external shape of the digital image processor shown in FIG. 1; FIG.

3 is a block diagram showing a configuration of an image synthesizing apparatus in a digital image processor according to the present invention.

4 is a diagram illustrating an example of image synthesis processing implemented in the apparatus of FIG.

5 is a flowchart illustrating an operation of an image synthesizing method in the digital image processor according to the first embodiment of the present invention.

6 is a flowchart illustrating an operation of the image synthesizing method in the digital image processor according to the second embodiment of the present invention.

Claims (8)

As a digital image processor, And a digital signal processing means for capturing and storing the first and second images successively and reducing the size of the arbitrarily selected sub-image among the first and second images to synthesize the sub-image with the main image, Wherein the synthesized image is stored in a folder different from the first image and the second image. The digital signal processing apparatus according to claim 1, wherein the digital signal processing means Wherein when the sub image is selected in the displayed composite image, the size of the sub image is enlarged to the size of the main image, and the size of the main image is reduced to the size of the sub image. As a digital image processor, And a digital signal processing means for selecting the stored first and second images and reducing the sizes of arbitrarily selected sub-images among the first and second images to synthesize them with the main image, Wherein the synthesized image is stored in a folder different from the first image and the second image. The digital signal processing apparatus according to claim 3, wherein the digital signal processing means Wherein when the sub image is selected in the displayed composite image, the size of the sub image is enlarged to the size of the main image, and the size of the main image is reduced to the size of the sub image. A method of operating a digital image processor, Capturing and storing a first image; Sequentially photographing and storing a second image; Reducing a size of a sub-image arbitrarily selected from the first and second images and synthesizing the sub-image with a main image; And And storing the synthesized image in a folder different from the first image and the second image. 6. The method of claim 5, Wherein the size of the sub image is enlarged to a size of a main image and the size of the main image is reduced to a size of a sub image if the sub image is selected in the displayed composite image. A method of operating a digital image processor, Selecting a stored first image; Selecting a stored second image; Reducing a size of a sub-image arbitrarily selected from the first and second images and synthesizing the sub-image with a main image; And And storing the synthesized image in a folder different from the first image and the second image. 8. The method of claim 7, Wherein the size of the sub image is enlarged to a size of a main image and the size of the main image is reduced to a size of a sub image if the sub image is selected in the displayed composite image.

Images