KR101411317B1 - Apparatus and method for enlargementing photographing range in digital image processing device - Google Patents

Abstract

The present invention relates to a digital image processing apparatus and method, and more particularly, to an apparatus and method for enlarging a photographic range in a digital image processor capable of acquiring a wider range of images by using overlapping angles of view from a moving amount of a lens will be. In a digital image processor, a digital image processor is a digital image processor that moves a lens in first and second directions with a single shutter input, and then photographs the first and second images to overlap the first and second images And digital signal processing means for calculating a non-overlapping portion and further displaying on the screen a portion that does not overlap based on overlapping portions of the first and second images.

Panoramic imaging, lens shift detection, overlapping parts of the image, non-overlapping parts of the image

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital image processing apparatus,

The present invention relates to a digital image processing apparatus and method, and more particularly, to an apparatus and method for enlarging a photographic range in a digital image processor capable of acquiring a wider range of images by using overlapping angles of view from a moving amount of a lens will be.

In the digital image processing apparatus, since the angle of view varies depending on the lens, it is difficult to capture an important image when the angle of view is insufficient, or the target image is reduced in size due to insufficient angle of view.

In this case, most digital image processing devices provide a panorama function to compensate for insufficient angle of view. Although the panorama function is implemented in various ways, the basic function is a method in which a user moves the digital image processing apparatus and superimposes the screen switching according to the movement. In this case, depending on the user's ability or the image condition, good results are obtained and bad results are obtained. Especially, a user who is not proficient can not use it because he thinks it is a function that can not be used properly.

The panorama function captures one screen after the user captures a continuous image horizontally or vertically so as to soften the overlapping of the two images to obtain one generally unobtainable image. However, in order to obtain such images, it is highly dependent on the work to be performed and the skill of the photographer. Therefore, it is possible for beginners to take a somewhat awkward image.

In order to automatically perform the panorama function, a tripod method is used. However, since it requires a tripod function in addition to a function of a digital image processing device, there is a problem that it must be produced separately for selling in a separate set. If you do not want to get a big image, but you want to get only a slight angle of view, you can be said to be inferior in portability and convenience.

When the angle of view is insufficient To capture a subject in one image, you can shoot from a distance or use the panorama function. However, the panorama function allows to obtain a larger image than the angle of view, but it can be complex or difficult to use, and it is easy to acquire an awkward image. In addition, when a slight enlargement of the angle of view is aimed at, it can be unnecessarily complicated.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus and method for enlarging a photographed range in a digital image processor capable of acquiring a wider range of images by using an overlapping angle of view from a moving amount of a lens.

According to an aspect of the present invention, there is provided a digital image processor for moving a lens in a first direction and a second direction by a single shutter input, And a digital signal processing means for calculating a portion which does not overlap with the overlapping portion of the first and second images and further displaying on the screen a portion which does not overlap based on the overlapping portion of the first and second images .

In the present invention, the first and second directions may be a direction shifted to the left and right sides of the lens, or a direction shifted upward and downward of the lens.

In the present invention, the digital signal processing unit may include an image acquiring unit that acquires the first and second images by moving the lens in the first and second directions with a single shutter input and then photographing the first and second images; A lens movement amount detector for detecting a movement amount in the first and second directions with respect to the lens; And calculating a portion that does not overlap with the overlapping portion of the first and second images from the detected amount of movement of the lens, and based on the overlapped portion of the first and second images, And an image synthesis unit for synthesizing the partial images to generate one image.

According to an aspect of the present invention, there is provided a digital image processor including a digital image processor, the method comprising: (a) moving a lens in a first direction and a second direction with a single shutter input; 1 and a second image; (b) detecting an amount of movement of the lens in the first and second directions; And (c) calculating, from the detected amount of movement of the lens, a portion that does not overlap with a portion where the first and second images overlap with each other, and a portion that does not overlap with the overlapping portion of the first and second images And a digital signal processing means for displaying the digital signal.

In the present invention, the first and second directions may be a direction shifted to the left and right sides of the lens, or a direction shifted upward and downward of the lens.

As described above, according to the present invention, a wider range of images can be obtained by using the overlapping angle of view from the amount of movement of the lens.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a perspective view showing the front and top contours of a digital image processor.

The shutter-release button 11 is opened and closed to expose the CCD or film to light for a predetermined time, and the image is recorded on the CCD by appropriately exposing the subject in cooperation with the aperture (not shown).

The shutter-release button 11 generates the first and second image pickup signals by the photographer input. When the first shutter-release button 11 is input as a half-shutter signal, the digital image processor focuses and adjusts the amount of light. At this time, the display unit 25 lights green. When the focus of the first shutter-release button 11 is focused and the amount of light is adjusted, a second shutter-release button 11 as a full shutter signal is input to capture an image.

The power button 13 is input for supplying power to the digital image processor and operating it.

The flash 15 illuminates bright light momentarily when shooting in a dark place. The flash mode includes auto flash, forced flash, no flash, red-eye reduction, and slow synchro flash.

The auxiliary light 17 supplies light to the subject so that the digital image processor automatically catches the focus quickly and accurately at the time of lack of light or at night.

The lens unit 19 receives light from an external light source and processes the image.

FIG. 2 is a rear view showing the rear external appearance of the digital image processor shown in FIG. 1. The wide-angle zoom button 21w, the telephoto-zoom button 21t, the display unit 23, Input buttons B1 to B14 (hereinafter referred to as buttons B1 to B14).

The wide-angle zoom button 21w or the telephoto-zoom button 21t widens the view angle or narrows the view angle depending on the input, in particular, when the size of the selected exposure area is to be changed. When the wide angle-zoom button 21w is input, the size of the selected exposure area is reduced, and when the telephoto-zoom button 21t is input, the size of the selected exposure area is increased.

The buttons B1 to B14 are provided in the rows and columns of the display unit 23. The buttons B1 to B14 provided in the row and column of the display unit 23 are provided with a touch sensor (not shown) or a contact type switch (not shown).

That is, the touch sensors are provided on the buttons B1 to B14 to move up / down / left / right while touching the buttons B1 to B7 of the horizontal row or the buttons B8 to B14 of the vertical row, It is possible to select any value (e.g., color or brightness) of the items, or activate a submenu icon included in the main menu icon.

In addition, the buttons B1 to B14 are provided with a contact type switch, so that the main menu icon and the sub menu icon can be directly selected to execute the corresponding function. The touch sensor requires a relatively weak touch compared to the contact switch input, but the contact switch input requires a relatively strong touch compared to the touch sensor input.

3 is a block diagram showing the configuration of an image pickup range enlarging apparatus in the digital image processor according to the present invention. The image pickup apparatus includes a display unit 23, a user input unit 31, an image pickup unit 33, an image processing unit 35, 37 and a digital signal processing unit 39. [

The user input unit 31 includes a shutter-release button 11 that is opened and closed to expose a CCD or a film to light for a predetermined period of time, a power button 13 that inputs power to supply power, A wide angle-zoom button 21w and a telephoto-zoom button 21t for narrowing the angle of view and a touch sensor or a touch sensor provided in the horizontal and vertical columns around the display unit 23 for character input or menu selection and execution. There are buttons B1 to B14 equipped with switches.

The imaging section 33 includes a shutter, a lens section, a diaphragm, and a charge coupled device (CCD) and an ADC (not shown). The shutter is a mechanism that adjusts the amount of light that is exposed with the iris. The lens unit receives light from an external light source and processes the image. At this time, the diaphragm adjusts the amount (light amount) of the incident light according to the degree of opening and closing. The opening / closing degree of the diaphragm is controlled by the digital signal processing section 39. [

The CCD accumulates the amount of light input through the lens unit and outputs the image captured by the lens unit according to the accumulated light amount in accordance with the vertical synchronization signal. Image acquisition by a digital image processor is performed by a CCD which converts the light reflected from the subject into an electrical signal. In order to obtain a color image using a CCD, a color filter is required, and a filter (not shown) called a color filter array (CFA) is employed in most cases. CFA has a regularly arranged structure that passes only light that represents one color per pixel, and it has various forms according to the arrangement structure. The ADC converts the analog video signal output from the CCD into a digital signal.

The image processing unit 35 processes the digitally converted RAW data so that it can be displayed. The image processing unit 35 removes a black level due to the dark current generated in the CCD and the CFA filter which are full of temperature change. The image processing unit 35 performs gamma correction to encode information in accordance with the nonlinearity of human vision. The image processing unit 35 performs CFA interpolation for interpolating the Bayer pattern implemented with the GGR-corrected RGRG line and the GBGB line into RGB lines. The image processing unit 35 converts the interpolated RGB signals into YUV signals, performs edge compensation for filtering the Y signals by a high-pass filter, and calculates color values of the U and V signals using a standard color coordinate system Corrects the color correction, and removes these noises. The image processing unit 35 compresses and processes the Y, U, and V signals from which the noise has been removed to generate a JPEG file, and the generated JPEG file is displayed on the display unit 23 and stored in the storage unit 37 . All the operations of the image processing unit 35 operate under the control of the digital signal processing unit 39. [

The digital signal processing unit 39 moves the lens in the first and second directions with one shutter input and then photographs the first and second images to calculate a portion that does not overlap with the overlapping portion of the first and second images And further displays on the display unit 23 a portion that does not overlap based on the overlapping portion of the first and second images.

To this end, the digital signal processing unit 39 includes an image acquisition unit 39-1, a lens movement amount detection unit 39-2, and an image synthesis unit 39-3.

The image acquiring unit 39-1 acquires the first and second images by moving the lens in the first and second directions as shown in FIG. 4 by capturing the first and second images with a single shutter input . Here, the first and second directions of the lens mean horizontal enlargement, that is, left and right directions, or vertical expansion, that is, upward and downward directions. Furthermore, in the case of full enlargement, the image can be acquired by moving the lens to the upper left, upper right, lower left, and lower right.

The lens movement amount detection unit 39-2 detects the movement amounts in the first and second directions with respect to the lens. The camera shake correction module is composed of a lens (not shown) and a sensor (not shown), and the sensor output value changes according to the movement of the lens. (39-2) can detect the lens movement amount by receiving this sensor output value. The lens shift amount can be calculated by the lens shift amount bits output from the sensor × the pixel conversion coefficient per unit bit (the number of CCD pixels), and the pixel conversion coefficient per unit bit is influenced by the sensitivity of the lens.

The image synthesizing unit 39-3 calculates a portion that does not overlap with the overlapping portion of the first and second images from the detected amount of movement of the lens, and outputs the first and second images And generates an expanded image by combining the non-overlapping portions.

5A and 5B show an example in which two images are photographed by using the panorama function and the shutter-release button 11 is used to input two images. FIG. 5A is an image of the lens taken in the first direction, that is, the left direction by (a-1), FIG. 5B is an image taken by moving the lens in the second direction, to be. The overlapping part (c-1) and the non-overlapping part (a-1) and (b-1) of the panoramic images can be calculated from the lens shift amounts (a-1) and (b-1). The image synthesizing unit 39-3 displays the non-overlapping portions a-1 and b-1 on the display unit 23 based on the overlapped portion c-1 of the panoramic images, The image as shown in FIG. 5C can be obtained.

Hereinafter, a method of enlarging a photographing range in the digital image processor according to the present invention will be described in detail with reference to FIG. The method of enlarging the photographic range in the digital image processor according to the present invention can be performed in a digital image processor as shown in FIG. 3. According to the embodiment, the main algorithm of the operation method is And may be performed in the digital signal processing unit 39.

When the live view image is displayed on the display unit 23 in step 601, the digital signal processing unit 39 receives the input of the shutter-release button 11 in step 603.

When the shutter-release button 11 is input, the digital signal processing unit 39 first moves the lens in the first direction to capture the first image (step 605), and then moves the lens in the second direction And the second image is captured (Step 607).

Here, the first and second directions of the lens mean horizontal enlargement, that is, left and right directions, or vertical expansion, that is, upward and downward directions. Furthermore, in the case of full enlargement, the image can be acquired by moving the lens to the upper left, upper right, lower left, and lower right.

Subsequently, the digital signal processing unit 39 detects the amount of lens movement from the first and second panoramic images (Step 609).

The camera shake correction module is composed of a lens (not shown) and a sensor (not shown) so that the sensor output value And the digital signal processing unit 39 can detect the lens movement amount by receiving the sensor output value. The lens shift amount can be calculated by the lens shift amount bits output from the sensor × the pixel conversion coefficient per unit bit (the number of CCD pixels), and the pixel conversion coefficient per unit bit is influenced by the sensitivity of the lens.

When the amount of movement of the lens is detected, the digital signal processor 39 calculates a portion that does not overlap the overlapping portion of the first and second images, and a portion that does not overlap based on the overlapping portion of the first and second images, 23) (step 611).

5A and 5B show an example in which two images are photographed by using the panorama function and the shutter-release button 11 is used to input two images. FIG. 5A is an image of the lens taken in the first direction, that is, the left direction by (a-1), FIG. 5B is an image taken by moving the lens in the second direction, to be. The overlapping part (c-1) and the non-overlapping part (a-1) and (b-1) of the panoramic images can be calculated from the lens shift amounts (a-1) and (b-1). The image synthesizing unit 39-3 displays the non-overlapping portions a-1 and b-1 on the display unit 23 based on the overlapped portion c-1 of the panoramic images, The image as shown in FIG. 5C can be obtained.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a perspective view showing the front and top contours of a digital image processor.

FIG. 2 is a rear view showing the rear external shape of the digital image processor shown in FIG. 1; FIG.

3 is a block diagram showing a configuration of an imaging range enlarging apparatus in a digital digital image processor according to the present invention.

Fig. 4 is a view for explaining the movement of the lens in Fig. 3;

FIG. 5 is a view showing an embodiment of enlarging the photographing range in FIG.

FIG. 6 is a flowchart illustrating an operation of a method of enlarging a photographic range in a digital image processor according to the present invention.

Claims (5)

As a digital image processor, The first image is photographed by moving the lens in the first direction with one shutter input, the second image is photographed by moving the lens in the second direction, Calculates a portion that does not overlap with the overlapping portion of the first and second images, And digital signal processing means for synthesizing overlapping portions and non-overlapping portions of the first and second images and displaying them on a screen. 2. The method of claim 1, wherein the first and second directions Wherein the lens is a direction shifted leftward and rightward, or a direction shifted upward and downward of the lens. The digital signal processing apparatus according to claim 1, wherein the digital signal processing means An image acquiring unit for acquiring first and second images by moving the lens in first and second directions with a single shutter input and then photographing the first and second images; A lens movement amount detecting unit for detecting a movement amount in the first and second directions with respect to the lens using the camera shake correction module; And Calculating a portion where the first and second images do not overlap with a portion where the first and second images overlap each other based on the detected amount of movement of the lens, and synthesizing non-overlapping portions of the first and second images with reference to overlapping portions of the first and second images, And an image synthesizing unit for generating an image based on the image data. A method of operating a digital image processor, (a) capturing a first image by moving a lens in a first direction with a single shutter input, and moving the lens in a second direction to capture a second image; (b) detecting an amount of movement of the lens in the first and second directions; And (c) calculating, from the detected amount of movement of the lens, a portion that does not overlap with the overlapping portion of the first and second images, and displaying the overlapping portion and the non-overlapping portion of the first and second images on a screen How to enlarge the shooting range. 5. The method of claim 4, wherein the first and second directions Wherein the lens is a direction shifted leftward and rightward or a direction shifted upward and downward by the lens.

Images