KR20080089839A - Apparatus and method for photographing image - Google Patents

Abstract

An image capturing apparatus and method are provided to induce a pre-set image capturing composition by outputting a current image capturing composition as audible information in capturing an image to thus resolve a problem of repeated image capturing. A face recognizing unit(49-1) detects the composition of a subject from a preview image to be captured. A comparing unit(49-2) compares the detected composition of the subject with a reference composition. A controller(49-3) controls to output an audible alarm signal until the composition of the subject and the reference composition become consistent. When the composition of the subject and the reference composition are consistent, the controller controls to output an audible consistent signal. The composition of the subject and the reference composition are size, position and direction information of the subject to be captured. The reference composition is set by a user. The controller controls to output each different audible alarm signal until the composition of the subject and the reference composition are consistent.

Description

Apparatus and method for photographing image

1 is a diagram illustrating an embodiment of general subject photographing and self photographing.

2 is a perspective view showing the front and the top of the digital camera as an example of the image photographing apparatus according to the present invention.

FIG. 3 is a rear view illustrating a rear shape of the digital image processing apparatus of FIG. 1.

4 is a block diagram illustrating a configuration of the image capturing apparatus illustrated in FIGS. 1 and 2.

5 is a diagram illustrating an example of an audio warning signal and an audio coincidence signal generated according to a composition of a subject in the image capturing apparatus of FIG. 4.

6 is a flowchart showing the operation of the image capturing method according to the present invention.

The present invention relates to an image capturing apparatus and a method, and more particularly, to an image capturing apparatus and method for providing a subject composition information displayed on a preview screen as auditory information to guide a subject composition to be photographed to a set composition. It is a tube.

Recently, with the development of image processing technology, a video recording device such as a mobile phone camera that adds an image capturing function to a portable communication terminal such as a digital camera, a camcorder, and even a mobile phone, which is easy to carry, has been widely used. Such image capturing devices have a moving picture capturing function for a moving subject as well as a still picture. In particular, the image capturing device is widely used for capturing an image of a person.

FIG. 1A is a diagram illustrating an example of photographing a general subject, and it may be understood that the present invention relies only on visual information of a user. FIG. 1B is a view illustrating an embodiment of self-taking when the LCD is present at the rear of the image capturing apparatus. Since the LCD at the rear is not visible at the time of self-taking, reliability for obtaining a desired picture is low.

As described above, the method of recognizing subject information of the image capturing apparatus can be visually determined. Therefore, a user who is uncomfortable with vision cannot operate the image capturing apparatus. Also, in self-mode shooting yourself, if the LCD does not rotate, you need to shoot repeatedly until the desired image is obtained, and even if you are familiar with how to operate the image capture device, you need to visually check the LCD and compose the image. A problem occurs.

SUMMARY OF THE INVENTION The present invention has been made in an effort to provide an image capturing apparatus and method for providing a subject composition information displayed on a preview screen as auditory information when capturing an image, thereby inducing a subject composition to be photographed by a set composition. .

According to an aspect of the present invention, there is provided a digital image processing apparatus including a detector configured to detect a composition of a subject from a preview image to be photographed; A comparator for comparing the detected object composition and reference composition; And a control unit configured to control the audio warning signal to be output until the subject composition and the reference composition coincide with each other as a result of the comparison, and output the audio matching signal when the subject composition and the reference composition match.

In the present invention, the subject composition and the reference composition are characterized in that the size, position and direction information of the subject to be photographed.

In the present invention, the reference composition is characterized in that the user can be set.

In the present invention, the control unit may control to output different auditory warning signals until the object composition matches the reference composition.

In the present invention, the control unit may control to automatically photograph the subject after a predetermined time has elapsed after the auditory matching signal is output.

In the present invention, the auditory warning signal and the auditory matching signal controlled by the control unit are characterized in that the voice message signal.

According to an aspect of the present invention, there is provided a digital image processing method including: (a) detecting a composition of a subject from a preview image to be photographed; (b) comparing the detected object composition and reference composition; And (c) outputting an auditory warning signal until the subject composition matches the reference composition, and outputting an auditory matching signal when the subject composition matches the reference composition.

The method may further include automatically photographing the subject when a predetermined time elapses after the auditory coincidence signal is output.

In the present invention, in the step (c) it is characterized in that the control so that different auditory warning signals are output until the object composition and the reference composition is identical.

In the present invention, the auditory warning signal and the auditory matching signal of step (c) are characterized in that the voice message signal.

Hereinafter, with reference to the accompanying drawings will be described in detail the present invention.

2 is a perspective view showing the front and the top of the digital camera as an example of the image photographing apparatus according to the present invention.

Referring to FIG. 2, there is a shutter-release button 11, a power button 13, a flash 15, an auxiliary light 17, and a lens unit 19.

The shutter release button 11 is opened and closed to expose the CCD or film to light for a predetermined time, and records the image on the CCD by properly exposing the subject in conjunction with an aperture (not shown).

The shutter release button 11 generates the first and second image capturing signals by a photographer input. When the first shutter release button 11 as a half shutter signal is input, the digital image processing apparatus focuses and adjusts the amount of light, and when the focus is achieved, the green light is turned on in the display unit 25. . When focus is achieved by the input of the first shutter release button 11 and the amount of light is adjusted, the second shutter release button 11 as a full shutter signal is input to capture an image.

The power button 13 is input to supply power to and operate the digital image processing apparatus.

The flash 15 brightens the bright light instantly when shooting in a dark place. Flash modes include auto flash, forced flash, flash off, red-eye reduction, and slow synchro.

The auxiliary light 17 supplies light to the subject so that the digital image processing apparatus automatically focuses quickly and accurately when the amount of light is insufficient or at night.

The lens unit 19 receives light from an external light source and processes an image.

FIG. 2 is a rear view illustrating a rear shape of the image processing apparatus shown in FIG. 1.

Referring to FIG. 2, a wide angle zoom button 21w, a telephoto zoom button 21t, a function button 23, and a display unit 25 are provided at the rear of the digital image processing apparatus. And a speaker 27 as an audio signal output section.

The wide-zoom button 21w or the tele-zoom button 21t increases the angle of view or narrows the angle of view depending on the input, particularly when the size of the selected exposure area is to be changed. When the wide-zoom button 21w is input, the size of the selected exposure area is reduced, and when the tele-zoom button 21t is input, the size of the selected exposure area is increased.

The function button 23 includes a total of five buttons including an up button, a down button, a left button, a right button and a menu / OK button. The function button 23 is input to execute various menus related to the operation of the digital image processing apparatus, and each of the keys may be used as a shortcut key.

The speaker 27 outputs a voice signal stored in the camera, for example, a voice signal of a stored video, a stored music file signal, and the like. In the present invention, the speaker 27 outputs an auditory warning signal until the subject composition to be photographed by the control signal coincides with the reference composition, and outputs an auditory coincidence signal when the subject composition matches the reference composition.

4 is a block diagram showing the configuration of the image capturing apparatus illustrated in FIGS. 1 and 2, wherein the display unit 25, the speaker 27, the user input unit 41, the imaging unit 43, and the image processing unit 45 are shown. , A storage unit 47 and a digital signal processing unit 49. In the present invention, the digital signal processor 49 includes a face recognition unit 49-1, a comparator 49-2, and a controller 49-3.

1 and 2, the user input unit 41 may include a shutter release button 11 that opens and closes to expose a CCD or a film to light for a predetermined time, and a power button that turns on / off an operation of the digital image processing apparatus. (13) An input for executing a wide angle-zoom button 21w or a tele-zoom button 21t and various menus relating to the operation of the digital image processing apparatus to widen the angle of view or narrow the angle of view according to the input. There is a function button 23.

The imaging unit 43 includes a shutter-release button 11, a lens unit not shown in the figure, an aperture, a charge coupled device (CCD), and an ADC.

The shutter release button 11 is a mechanism for adjusting the amount of light exposed together with the aperture. The lens unit receives light from an external light source and processes an image. At this time, the iris adjusts the amount of light incident (light quantity) according to the degree of opening and closing. The opening and closing degree of the iris is controlled by the digital signal processing unit 49.

The CCD accumulates the amount of light input through the lens unit and outputs an image captured by the lens unit in accordance with the accumulated light amount in accordance with the vertical synchronization signal. Image acquisition of the digital image processing apparatus is performed by a CCD that converts light reflected from a subject into an electrical signal.

The image processor 45 performs signal processing to display an image signal converted into an electrical signal. To this end, the image processor 45 removes the black level generated by the dark current and performs gamma correction to encode the input image signal according to the nonlinearity of human vision. In addition, the image processor 45 performs CFA interpolation to interpolate the Bayer pattern implemented by the RGRG line and the GBGB line of the gamma-corrected predetermined data into the RGB line, converts the interpolated RGB signal into a YUV signal, By performing the Y signal filtering, the edge compensation for sharply processing the image and the color correction for correcting the color values of the U and V signals using the standard color coordinate system are performed, and the noise is removed. Afterwards, the image processor 45 generates an Exif file by compressing and signal-processing Y, U, and V signals from which noise is removed, and the generated Exif file is displayed on the display unit 25 and stored in the storage unit 47. do. All of the operations of the image processor 45 operate under the control of the digital signal processor 49.

The digital signal processor 49 may include a face recognition unit 49-1, a comparator 49-2, and the like so that the camera can be operated with only the auditory information without departing from the limitation of the image photographing device operation method that depends only on the visual information. The control unit 49-3 is included.

The face recognizing unit 49-1 functions as a detection unit that detects a composition of the subject from the preview image to be photographed. In more detail, the face recognizing unit 49-1 detects face information as a composition of a subject from the preview image displayed on the display unit 25, ie, a face size, a face position, and a face direction in the display unit 25. Detect.

When detecting the size of the face, the face recognizing unit 49-1 uses a method of detecting a face area based on color or a face area based on an edge, and the face size detection is already known. Many details are given, so detailed description is omitted. When detecting the position of the face, the face recognizing unit 49-1 may calculate the face position based on a distance between the center of the extracted face and a predetermined center of the display unit 25. The face recognizing unit 49-1 may detect a face direction in the form of a triangle composed of eyes and mouth from the extracted face at the time of detecting the direction of the face. Detailed description will be omitted.

The reference structure is stored in the storage unit 47. The reference composition stored in the storage unit 47 stores reference face information, that is, the size of the reference face, the position of the reference face, and the direction information of the reference face. The reference composition stored in the storage unit 47 is used as a reference composition for guiding the composition of the face image displayed on the display unit 25 to the desired photographing composition at the time of photographing. This reference composition may be set to a default value, or may be set to an appropriate value according to a user's preference.

The comparator 49-2 compares the current face composition detected by the face recognition unit 49-1 with the reference composition stored in the storage unit 47, and outputs the result to the controller 49-3.

The controller 49-3 controls the speaker 27 to output an auditory warning signal when the comparison result of the comparator 49-2 does not match the composition of the current face and the reference composition. In addition, the controller 49-3 controls the speaker 27 to output an audio matching signal when the comparison result of the comparator 49-2 matches with the composition of the current face.

The controller 49-3 compares the current face size with the reference face size stored in the storage 47 and outputs an auditory warning signal, and compares the current face position with the reference face position stored in the storage 47. If the comparison does not match, the audio warning signal is output, and if it does not match by comparing the current face direction and the reference face direction stored in the storage unit 47, and outputs the audio warning signal, the auditory controlling the final speaker 27 The red warning signal becomes (acoustic warning signal of face size + auditory warning signal of face position + auditory warning signal of face direction).

After the speaker 27 outputs the audio coincidence signal, the controller 49-3 may control to capture an image by an automatic shutter input after a predetermined time (for example, 2 seconds). After the composition of the current face and the reference composition coincide with each other, hand shake may occur in a process of inputting the shutter-release button 11 by the user to capture an undesirable image. Therefore, the controller 49-3 may control the speaker 27 to automatically capture an image of the current face composition after a predetermined time elapses after the speaker 27 outputs an audio coincidence signal.

5A to 5I illustrate an example in which the controller 49-3 controls the audio signal and the audio coincidence signal to be output through the speaker 27 according to the composition of the subject.

First, FIG. 5F illustrates an optimal screen in which the face composition (face size, position, and orientation) displayed on the preview screen of the display unit 25 matches the reference composition stored in the storage unit 47. At this time, the controller 49-3 controls the acoustic matching signal S _f to be output through the speaker 27.

5A illustrates an example in which the face composition displayed on the preview screen of the display unit 25 is biased to the upper left part. Figure 5a and Figure does not match all of the size, position or orientation of the face at the time of comparison 5f, the control unit (49-3) is controlled so that the audible warning signal (S _a) output through the speaker 27.

5B illustrates an example in which the face composition displayed on the preview screen of the display unit 25 is shifted to the left center portion. Since the size, position, and orientation of the face do not coincide with each other in comparison with FIGS. 5B and 5F, the controller 49-3 controls the audio warning signal S _b to be output through the speaker 27. In this case, it can be seen that the warning signal S _a and the warning signal S _b are different audio signals.

5C illustrates an example in which a face composition displayed on the preview screen of the display unit 25 is positioned at the center. 5C and 5F, the position of the face coincides with FIG. 5F, but the size and direction of the face do not coincide, so that the controller 49-3 outputs the auditory warning signal S _c through the speaker 27. Control as possible. In this case, it can be seen that the warning signal S _c is an auditory signal different from the other warning signals _Sa and S _b .

5D illustrates an example in which a face composition displayed on the preview screen of the display unit 25 is similar to that of FIG. 5A, but the size of the face is larger than that of FIG. 5A. Since the size, position, and direction of the face do not coincide with each other in comparison with FIGS. 5D and 5F, the controller 49-3 controls the audio warning signal S _d through the speaker 27. In this case, it can be seen that the warning signal S _d is an audio signal different from the other warning signals _Sa , S _b , and S _c .

FIG. 5E illustrates an example in which a face composition displayed on the preview screen of the display unit 25 is similar to that of FIG. 5B, but the size of the face is larger than that of FIG. 5B. Since the size, position, and direction of the face do not coincide with each other in comparison with FIGS. 5E and 5F, the controller 49-3 controls the audio warning signal S _e to be output through the speaker 27. At this time, it can be seen that the warning signal (S _e) is different warning signal _{(S a, S b, S} c, S d) and other audible signals.

5G illustrates an example in which a face composition displayed on the preview screen of the display unit 25 is similar to that of FIG. 5D, but the size of the face is larger than that of FIG. 5D. Since the size, the position, and the direction of the face do not coincide with each other in comparison with FIGS. 5G and 5F, the controller 49-3 controls the audio warning signal S _g to be output through the speaker 27. In this case, it can be seen that the warning signal S _g is an acoustic signal different from the other warning signals _Sa , S _b , S _c , S _d , and S _e .

5H illustrates an example in which a face composition displayed on the preview screen of the display unit 25 is similar to that of FIG. 5E, but the size of the face is larger than that of FIG. 5E. Since the size, position, and direction of the face do not coincide with each other in comparison with FIGS. 5H and 5F, the controller 49-3 controls the audio warning signal S _h to be output through the speaker 27. At this time, it can be seen that the warning signal (S _e) is different warning signal _{(S a, S b, S} c, S d, S e, S g) and other audible signals.

5I illustrates an example in which a face composition displayed on the preview screen of the display unit 25 is located at the center. Figure 5i and also the location of the face matching and Figure 5f when compared 5f, but because the size and orientation of the face do not match, the control unit (49-3) is an audible alarm signal (S _i) is output through the speaker 27 Control as possible. At this time, it can be seen that the warning signal (S _i) is other warning signals _{(S a, S b, S} c, S d, S e, S g, S g, S h) and other audible signals.

As described above, referring to FIG. 5, the controller 49-3 compares the composition of the current face, that is, the size, position, and direction of the face with the reference composition, that is, the size, position, and orientation of the reference face. Different acoustic warning signals are output until they match the composition, inducing the user to recompose the composition. When the user hears the auditory warning signal and recomposes the composition, the controller 49-3 may control to output the auditory coincidence signal when the composition of the current face matches the reference composition. In another embodiment, a pre-stored voice message signal for inducing a current face composition to a reference composition may be output. For example, when the composition of the current face does not match the reference composition, a message such as "Please recompose" may be output as a voice message signal. In addition, when the composition of the current face matches the reference composition, a voice message signal such as "Ulzzang composition. Automatically captures after 2 seconds" can be output.

Hereinafter, an image capturing method according to the present invention will be described in detail with reference to FIG. 6. The image synthesizing method of the digital image processing apparatus according to the present invention may be performed inside the image processing apparatus as shown in FIG. 4. According to an embodiment, the main algorithm of the operation method may be performed by the help of peripheral components in the apparatus. It may be performed in the digital signal processor 49.

When the user operates the power of the image capturing apparatus for capturing, the controller 49-3 displays the current face composition on the display unit 25 as a preview screen (S601).

In operation 603, the controller 49-3 detects a face composition. Upon detecting the composition of the face, the face recognition unit 49-1 detects the face size using a known method such as detecting a face region based on color or a face region based on an edge, and extracts the extracted face. The position of the face is calculated by the distance between the center of the display unit and the center of the preset display unit 25, and the face direction may be detected in a triangular form consisting of eyes and mouth from the extracted face size.

When a face composition including a face size, a position, and a direction is detected as described above, the comparator 49-2 compares the current face composition detected by the face recognition unit 49-1 with a reference composition stored in the storage unit 47. Compare (step 605). The reference composition stored in the storage 47 may be set to a default value, and may be set to an appropriate value according to a user's preference.

In operation 607, the controller 49-3 determines whether the detected face composition and the reference composition are the same.

If the detected face composition and the reference composition are not the same, the controller 49-3 controls to output different acoustic warning signals through the speaker 27 according to the detected detected facial composition (step 609). . The controller 49-3 compares the current face size with the reference face size stored in the storage 47 and outputs an auditory warning signal, and compares the current face position with the reference face position stored in the hypothesis 47. If the comparison does not match, the audio warning signal is output, and if it does not match by comparing the current face direction and the reference face direction stored in the storage unit 47, and outputs the audio warning signal, the auditory controlling the final speaker 27 The red warning signal becomes (acoustic warning signal of face size + auditory warning signal of face position + auditory warning signal of face direction). 5A to 5I except for FIG. 5F, an auditory warning signal output according to a currently detected face composition is illustrated and described above, and thus a detailed description thereof will be omitted.

Thereafter, the controller 49-3 continuously generates an auditory warning signal until the detected current face composition becomes a reference composition to induce a change in composition of the user (step 611).

If the detected face composition and the reference composition are the same, the controller 49-3 controls to output an auditory matching signal through the speaker 27 indicating that the currently detected face composition and the reference composition match (step 613). . 5F illustrates an acoustic matching signal output when the currently detected face composition matches the reference composition.

After the speaker 27 outputs the audio coincidence signal, the controller 49-3 captures an image by the automatic shutter input after a predetermined time (for example, 2 seconds) (step 615). After the composition of the current face and the reference composition coincide with each other, hand shake may occur in a process of inputting the shutter-release button 11 by the user to capture an undesirable image. Therefore, the controller 49-3 controls the speaker 27 to automatically capture an image of the current face composition after a predetermined time elapses after the speaker 27 outputs the audio coincidence signal.

As described above, the controller 49-3 compares the composition of the current face, that is, the size, position, and direction of the face with the reference composition, that is, the size, position, and direction of the reference face, and when the composition of the current face coincides with the reference composition, By controlling the output of a different acoustic warning signal until the user is encouraged to recompose the composition. When the user hears the auditory warning signal and recomposes the composition, the controller 49-3 may control to output the auditory coincidence signal when the composition of the current face matches the reference composition. In another embodiment, a pre-stored voice message signal for inducing a current face composition to a reference composition may be output. For example, when the composition of the current face does not match the reference composition, a message such as "Please recompose" may be output as a voice message signal. In addition, when the composition of the current face matches the reference composition, a voice message signal such as "Ulzzang composition. Automatically captures after 2 seconds" can be output.

As described above, according to the present invention, it is possible to conveniently operate the image capturing apparatus by providing an image capturing apparatus and a method capable of operating the camera using only the auditory information without departing from the limitation of the image capturing apparatus operating method depending only on the visual information. .

In addition, it is possible to solve the inconvenience of repetitive shooting by outputting the current shooting composition as auditory information at the time of image capturing and inducing the set shooting composition.

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

Claims (10)

A detector detecting a composition of the subject from the preview image to be photographed; A comparator for comparing the detected object composition and reference composition; And And a control unit configured to output an auditory warning signal until the subject composition and the reference composition coincide with each other as a result of the comparison, and output an audio matching signal when the subject composition and the reference composition match. The method of claim 1, wherein the subject composition and the reference composition is Imaging apparatus, characterized in that the size, position and direction information of the subject to be photographed. The method of claim 2, wherein the reference composition is Imaging device, characterized in that the setting is possible by the user. The method of claim 1, wherein the control unit And controlling to output different auditory warning signals until the subject composition matches the reference composition. The method of claim 1, wherein the control unit And the subject is automatically photographed when a predetermined time elapses after the auditory coincidence signal is output. The image capturing apparatus of claim 1, wherein the auditory warning signal and the auditory coincidence signal controlled by the control unit are voice message signals. (a) detecting the composition of the subject from the preview image to be taken; (b) comparing the detected object composition and reference composition; And and (c) outputting an auditory warning signal until the subject composition and the reference composition coincide with each other as a result of the comparison, and outputting an audio matching signal when the subject composition and the reference composition match. The method of claim 7, wherein and (d) automatically photographing the subject when a predetermined time elapses after the auditory coincidence signal is output. 8. The method of claim 7, wherein in step (c) And controlling to output audible warning signals until the subject composition matches the reference composition. 8. The method of claim 7, wherein the auditory warning signal and the auditory coincidence signal of step (c) are voice message signals.

Images