KR20110060297A - Digital photographing apparatus and controlling method thereof - Google Patents

Abstract

PURPOSE: A digital photographing device and a control method thereof are provided to detect a subject and photograph the subject in a desired structure through a front display unit. CONSTITUTION: A second display unit is turned on(402). A preview image is displayed on the second display unit(404). A user selects a sample picture for structure guide(406). A control unit extracts the contour line of a selected photograph(408). The control unit synthesizes the rest part with an input image(410). In case a photographing mode is long distance photographing, the control unit displays a structure guide(412,414). The control unit photographs and records(416,418).

Description

Digital photographing apparatus and controlling method

The present invention relates to a digital photographing apparatus, and more particularly, to a digital photographing apparatus having a plurality of display units and a control method thereof.

The same image is displayed on each display in a digital photographing apparatus (digital camera, digital camcorder) having a dual display. For example, a live view image, a preview view image, a playback image, and the like are displayed on the dual display in the same manner.

On the other hand, although it was possible to set a general grid guide to help the composition, there was no grid specialized for each composition, and even though there was a picture to refer to the composition, it was difficult to photograph the composition as it is. In addition, the photographer was able to adjust the camera, but there was a lack of a way to adjust the composition by moving the subject directly to the composition.

In the conventional method for helping self-photographing, it is disclosed that a user inputs an angle at which a face is best seen, and informs a user when a condition is taken. The recognition of the angle is calculated by reading the tilt angle of the current camera using a hardware sensor, for example, an acceleration sensor, and using the tilt angle of the face using information from the face detector.

The present invention has been made to solve the above problems of the prior art, an embodiment of the present invention is to provide a digital photographing apparatus and a control method thereof that can guide the composition through the front display.

According to an aspect of the present invention, there is provided a digital photographing apparatus including a first display unit and a second display unit, wherein the first display unit is located on a rear surface of the digital photographing device, and the second display unit is the digital display device. And a digital signal processor configured to be provided on the front surface of the photographing apparatus, respectively, to generate composition guide information based on the reference composition information and the input image, and to display the generated composition guide information on the second display unit.

The digital signal processor may include a photo recognition unit for extracting composition information of the sample picture, an image synthesizer for synthesizing the sample picture and the input image, and generates composition guide information based on the composition information and the input image of the sample picture. And a composition guide unit configured to display the controller and the generated composition guide information on the second display unit.

The image synthesizing unit may activate the contour of the subject of the sample picture to synthesize the input image.

The controller may generate, as composition guide information, whether or not a subject coincides with the contour line in the input image.

The composition guide information is characterized in that the match is expressed as color information.

The reference composition information is composition information extracted from the input image, and the composition guide information is information that the subject should move to match the subject of the input image with the reference composition information.

The controller generates composition guide information based on the composition information of the sample picture and the input image according to whether the camera is in a distance shooting or a near field photography.

The photo recognition unit may extract the person information from the sample picture, reduce the size of the picture, or process the picture into a front picture.

The digital signal processor automatically photographs the composition guide information displayed on the second display unit when the subject information of the input image matches.

According to another aspect of the present invention, there is provided a control method of a digital photographing apparatus including a first display unit and a second display unit, the method comprising: generating reference composition information; Generating composition guide information based on the generated reference composition information and the input image; And displaying the generated composition guide information on the second display unit.

The reference composition generating step may further include extracting composition information of a predetermined sample picture, wherein the composition guide information generating step synthesizes the sample picture and the input image, and combines the composition information and the input image of the sample picture. It is characterized by generating composition guide information as a basis.

The method may further include automatically photographing when the composition guide information displayed on the second display unit and the subject of the input image coincide.

In the synthesizing step, the contour of the subject of the sample picture is activated and synthesized with the input image.

In the generating step, composition guide information is generated whether or not the object is matched with the activated contour line in the input image.

The composition guide information is characterized in that the match is expressed as color information.

The reference composition information is composition information extracted from the input image, and the composition guide information is information that the subject should move to match the subject of the input image with the reference composition information.

The method may further include determining whether the camera is in a distance shooting or a near field shooting. The generating may include generating composition guide information based on the composition information of the sample picture and the input image according to the determination result. do.

The extracting step may include extracting person information from the sample picture, reducing the size of the picture, or processing the picture into a front picture.

In accordance with still another aspect of the present invention, there is provided a recording medium having recorded thereon a program for executing a control method of the digital photographing apparatus on a computer.

According to an embodiment of the present invention, the digital photographing apparatus detects a subject from a captured image and captures it according to a desired composition through the front display unit, and allows interaction between a camera, a photographer, and a subject, and according to size constraints of the front display unit. The problem of viewing and shooting the preview screen from a distance can be supplemented with composition guide information.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, only parts necessary for understanding the operation according to the present invention will be described, and descriptions of other parts may be omitted so as not to distract from the gist of the present invention.

In addition, terms and words used in the following description and claims should not be construed to be limited to ordinary or dictionary meanings, but are to be construed in a manner consistent with the technical idea of the present invention As well as the concept.

1 is a diagram illustrating an appearance of a digital photographing apparatus 100 according to an exemplary embodiment of the present invention, and the first display unit 164 and the second display unit 168 may be provided on the rear and front surfaces of the digital photographing apparatus, respectively. As shown in FIG. 1A, the first display unit 164 is disposed on a surface opposite to the surface on which the lens barrel 109 is disposed, and the second display unit 168 is the same surface on which the lens barrel 109 is disposed. Can be placed in.

FIG. 2 is a diagram illustrating a schematic internal structure of the digital photographing apparatus 100 shown in FIG. 1.

The digital photographing apparatus 100 according to the present invention includes a lens 110, a lens driver 111, an aperture 112, an aperture driver 113, an imaging device 115, an imaging device controller 116, and an analog signal processor ( 120, the program storage unit 130, the buffer storage unit 140, the data storage unit 150, the first display driver 162, the first display unit 164, the second display driver 166, and the second display unit 168, a digital signal processing unit 170, and an operation unit 180.

The lens 110 condenses the optical signal. The lens 110 includes a zoom lens that controls the angle of view to be narrowed or widened according to a focal length, and a focus lens that focuses a subject. These lenses may be configured as one lens, respectively. It may also consist of a cluster of a plurality of lenses.

The diaphragm 112 controls the amount of incident light by adjusting the degree of opening and closing.

The lens driver 111 and the aperture driver 113 receive control signals from the digital signal processor 170 to drive the lens 110 and the aperture 112, respectively. The lens driving unit 111 adjusts the focal length by adjusting the position of the lens, and performs auto focusing, zoom change, and focus change operations. The aperture driver 113 adjusts the opening and closing degree of the aperture, and in particular, controls the f number to perform operations such as auto focus, auto exposure compensation, focus change, depth of field, and the like.

The optical signal transmitted through the optical unit 110 reaches the light receiving surface of the imaging device 115 to form an image of the subject. The imaging device 115 may use a Charge Coupled Device (CCD) or a Complementary Metal Oxide Semiconductor Image Sensor (CIS) that converts an optical signal into an electrical signal. Such an image pickup device 115 may be controlled by the image pickup device control unit 116 sensitivity and the like. The imaging device controller 116 may control the imaging device 115 according to a control signal automatically generated by an image signal input in real time or a control signal manually input by a user's operation.

The exposure time of the imaging device 115 is adjusted with a shutter (not shown). The shutter includes a mechanical shutter that controls the incidence of light by moving a shade and an electronic shutter that controls an exposure by supplying an electrical signal to the imaging device 115.

The analog signal processor 120 performs noise reduction processing, gain adjustment, waveform shaping, analog-digital conversion processing, and the like on the analog signal supplied from the imaging device 115.

The digital photographing apparatus 100 includes a program storage unit 130 for storing a program such as an operating system, an application system, a buffer storage unit 140 for temporarily storing data or result data necessary for performing an operation, and an image signal. It includes a data storage unit 150 for storing a variety of information required for the program, including the image file.

In addition, the digital photographing apparatus 100 includes a first display unit 164 and a second display unit 168 to display an operation state thereof or image information photographed by the digital photographing apparatus 100. The first display unit 164 and the second display unit 168 may provide visual information and / or audio information to the user. In order to provide visual information, the first display unit 164 and the second display unit 168 may be, for example, a liquid crystal display panel (LCD), an organic light emitting display panel (OLED), or the like. The first display driver 162 and the second display driver 166 provide driving signals to the first display unit 164 and the second display unit 168, respectively. In an exemplary embodiment of the present invention, the first display driver 164 and the second display driver 168 are driven separately from the first display driver 162 and the second display driver 166, respectively. Of course, the display driver may be configured to drive the first display unit 164 and the second display unit 168 together.

In addition, the digital photographing apparatus 100 includes a digital signal processor 170 that processes an input image signal and controls each component in accordance with the external input signal. The digital signal processor 170 reduces noise with respect to the input image data, performs gamma correction, color filter array interpolation, color matrix, color correction, Image signal processing for image quality improvement such as color enhancement may be performed. In addition, the image data may be generated by compressing the image data generated by the image signal processing to improve the image quality, or the image data may be restored from the image file. The compressed format of the video may be a reversible format or an irreversible format. As an example of a suitable format, it is also possible to convert to JPEG (Joint Photographic Experts Group) format, JPEG 2000 format, or the like. The compressed image file may be stored in the data storage unit 150. In addition, the digital signal processing unit 170 can also perform non-sharpening, color processing, blur processing, edge emphasis processing, image analysis processing, image recognition processing, image effect processing, and the like. Face recognition, scene recognition processing, and the like can be performed by the image recognition processing. In addition, the digital signal processing unit 170 may perform display image signal processing for displaying on the first display unit 164 and the second display unit 168. For example, luminance level adjustment, color correction, contrast adjustment, outline enhancement adjustment, screen division processing, character image generation and the like, and image synthesis processing can be performed. The digital signal processing unit 170 may be connected to an external monitor to perform a predetermined image signal processing to be displayed on the external monitor, and transmit the processed image data so that the corresponding image may be displayed on the external monitor.

In addition, the digital signal processor 170 may execute a program stored in the program storage unit 130 or may include a separate module to generate a control signal for controlling auto focusing, zoom change, focus change, and automatic exposure compensation. , The lens driver 111, the aperture driver 113, and the imaging device controller 116, and collectively control the operations of the components included in the digital photographing apparatus 100 such as a shutter and a flash.

The operation unit 180 may include a member for a photographer (user) to operate the digital camera or to perform various settings when photographing. For example, it may be implemented in the form of a button, a key, a touch panel, a touch screen, a dial, and the like, and may include power on / off, recording start / stop, playback start / stop / search, driving the optical system, mode switching, and menu operation. And a photographer operation signal such as a selection operation can be input. As an example, the shutter button may be pressed halfway, fully pressed, or released by the photographer. When the shutter button is pressed halfway (S1 operation), it outputs the focus control start operation signal, and the focus control is terminated by releasing it halfway. The shutter button can output a shooting start operation signal when the shutter button is pressed down (S2 operation). The operation signal is transmitted to the DSP 170 or the like, thereby driving the corresponding component.

3 is a detailed block diagram of the digital signal processor 170 shown in FIG. 2.

The digital signal processor 170 generates composition guide information based on the reference composition information and the input image, and displays the generated composition guide information on the second display unit 168. Here, the reference composition information refers to information about an angle or size of a face of a subject in a previously obtained image, for example, a sample picture. In addition, the reference composition information is composition information using the position of the center point of the subject as the reference point of the composition through the input image, that is, the preview image, or the golden division point of the general composition, for example, the golden division composition, as well as the person in the preview image. It may be composition information using information based on the reference. In addition, information directly designating a point where the face of the subject is to be positioned by the user or the photographer may be used as the reference composition information.

Referring to FIG. 3, the digital signal processor 170 includes a controller 171, a photo recognizer 172, an image synthesizer 173, a composition determiner 174, and a composition guide 175.

The controller 171 controls the overall operation of the digital signal processor 170.

The picture recognition unit 172 extracts composition information of the sample picture. Here, the sample picture refers to a picture selected by the user as the best composition, and means a picture previously taken or a picture stored. The photo recognition unit 172 extracts the person information from the sample photo, reduces the size of the photo, or processes the front photo.

The photo recognition unit 172 recognizes the photo and stores it in the memory when the photo is taken. And after taking a picture, the corner can be found in the captured image through Conner Detection, and the picture can be recognized through a convex hull. Corner detection and convex hull techniques are well known techniques and will not be described in detail. In addition, a perspective view may be applied to a photograph taken at an angle due to camera tilt or lens distortion when the photograph is taken, so that the photograph viewed in front may be stored. In addition, since the stored image only needs to be viewed on the front display unit 168, the stored image is stored in a minimum size, for example, 1M, regardless of the resolution of the captured image. Due to this size reduction, it is possible to reduce the constraint on the execution speed for performing other processing algorithms and photo retrieval algorithms.

The image synthesizer 173 synthesizes the sample photograph and the input image. In the sample picture, only the composition information, for example, the contour image of the subject of the picture is left, and the remaining parts are deactivated and overlap with the input image.

The controller 171 generates composition guide information based on the composition information and the input image. The controller 171 generates, as composition guide information, whether or not the object is matched with the contour line, which is the composition information of the sample picture, and the input image. Here, the composition guide information is information on whether the subject is matched on the contour line and the input image, whether the match is expressed by color information, or information that the subject needs to move to match the subject of the input image to the composition information of the sample picture. Can be. Here, the controller 171 may determine the position of the person in the input image as shown in FIGS. 5A and 5B, and may set a reference point of the composition based on face position information obtained from face detection. In addition, the information may be utilized based on not only the person in the photographed picture but also the general composition, for example, the golden division point of the golden division composition.

The composition guide unit 175 displays the composition guide information generated by the controller 171 on the second display unit 168.

The controller 171 generates composition guide information based on the composition information of the sample photograph and the input image according to whether the photographing is in a distance shooting or a near field photography. That is, in the case of long distance shooting, the user is informed as an arrow as information about moving the subject as composition guide information, or in the case of short distance shooting, the outline is expressed as color information to match the input image with the outline of the sample picture. If it does not match the green color can be expressed in yellow color to inform the user.

In addition, when the composition guide information displayed on the second display unit 168 and the subject information of the input image coincide with each other, the controller 171 controls to automatically photograph.

4 is a flowchart illustrating a control method of a digital photographing apparatus according to another exemplary embodiment.

Referring to FIG. 4, in step 400, a composition guide mode is set. In step 402, the second display is turned on. Here, the second display unit is a display unit located on the front of the digital photographing apparatus and performs a function for displaying composition guide information.

The preview image is displayed on the second display unit 168, and in step 406, a sample photograph for composition guide is selected. In step 408, the outline of the selected picture is extracted. In step 410, only the outline is extracted from the selected sample picture, and the rest is deactivated and synthesized with the input image. In step 412, it is determined whether the shooting is near or far. In the case of near-field photography, images are taken and recorded in steps 416 and 418. In the case of remote shooting, a composition guide is made in step 414, and in step 416 and 418, pictures are taken and recorded. That is, in the case of near-field photography, only the match of the subject of the input image according to the outline is displayed, or the color information is notified to the user.

However, in the case of remote shooting, an arrow or the like is displayed on the second display unit as the composition guide information, and accordingly, when the user, i. The composition guide information and the arrow according to this are shown in FIG.

7A to 7E are flowcharts illustrating a control method of a digital photographing apparatus according to another exemplary embodiment.

7A to 7C illustrate extracting composition information from a sample picture. In FIG. 7A, a sample picture is displayed on the first display unit 164, and composition information of the sample limb is extracted in FIG. 7B. In FIG. 7C, new composition information of the sample picture is extracted.

In FIG. 7D, a plurality of sample pictures are displayed on the first display unit 164, and a user-selected sample picture is shown on the second display unit 168 of FIG. 7E.

In Fig. 7F, the outline of the sample picture is shown by the thick line, and the input image is displayed together. Here, the outline of the sample image as the input image and the composition guide information is shown together. In case of mismatch, the outline may be displayed in yellow. In Fig. 7G, while matching the contour while moving its position while looking at the contour, the contour turns green and is automatically photographed. Shooting is completed in Fig. 7H.

In the exemplary embodiment with reference to FIG. 7, color information of the outline is used as the composition guide information. However, in the case of remote photographing, the composition guide information may be displayed as an arrow as illustrated in FIG. 6. In the embodiment described with reference to FIG. 7, the pre-photographed picture is deactivated through the front display to overlap the preview image. If the person of the captured picture is a near-field picture, the position of the person where the user is deactivated through the front display is displayed. If you want to compose your shot in the frame, and if the person in the picture you want to shoot is mounted on a long-distance shot, for example on a tripod, seeing the front display makes it difficult to compose the shot. Make sure

The above embodiments have been described based on the digital photographing apparatus to which the present invention can be applied, but are not limited thereto. Those skilled in the art will appreciate that the present invention can be applied to camera phones, personal digital assistants (PDAs), and portable multimedia players (PMPs) with added camera functionality.

The device according to the invention comprises a processor, memory for storing and executing program data, permanent storage such as a disk drive, a communication port for communicating with an external device, a user such as a touch panel, keys, buttons, etc. Interface devices and the like. Methods implemented by software modules or algorithms may be stored on a computer readable recording medium as computer readable codes or program instructions executable on the processor. Here, the computer-readable recording medium may be a magnetic storage medium such as a read-only memory (ROM), a random-access memory (RAM), a floppy disk, a hard disk, ), And a DVD (Digital Versatile Disc). The computer-readable recording medium may be distributed over networked computer systems so that computer readable code can be stored and executed in a distributed manner. The medium is readable by a computer, stored in a memory, and executable on a processor.

All documents including publications, patent applications, patents, etc. cited in the present invention can be incorporated into the present invention in the same manner as each cited document individually and concretely, .

In order to facilitate understanding of the present invention, reference will be made to the preferred embodiments shown in the drawings, and specific terminology is used to describe the embodiments of the present invention. However, the present invention is not limited to the specific terminology, Lt; / RTI > may include all elements commonly conceivable by those skilled in the art.

The present invention can be represented by functional block configurations and various processing steps. Such functional blocks may be implemented in various numbers of hardware or / and software configurations that perform particular functions. For example, the present invention relates to integrated circuit configurations such as memory, processing, logic, look-up table, etc., which may execute various functions by the control of one or more microprocessors or other control devices. It can be adopted. Similar to how the components of the present invention may be implemented in software programming or software elements, the present invention includes various algorithms implemented in combinations of data structures, processes, routines or other programming constructs, including C, C ++ It may be implemented in a programming or scripting language such as Java, an assembler, or the like. The functional aspects may be implemented with an algorithm running on one or more processors. In addition, the present invention may employ the prior art for electronic environment setting, signal processing, and / or data processing. Terms such as "mechanism", "element", "means" and "configuration" can be used widely and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in conjunction with a processor or the like.

The specific acts described in the present invention are, by way of example, not intended to limit the scope of the invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connecting members of the lines between the components shown in the drawings are illustrative of the functional connection and / or physical or circuit connections as an example, in the actual device replaceable or additional various functional connections, physical Phosphorus connections, or circuit connections. Also, unless explicitly mentioned, such as " essential ", " importantly ", etc., it may not be a necessary component for application of the present invention.

The use of the terms " above " and similar indication words in the specification of the present invention (particularly in the claims) may refer to both singular and plural. In addition, in the present invention, when a range is described, it includes the invention to which the individual values belonging to the above range are applied (unless there is contradiction thereto), and each individual value constituting the above range is described in the detailed description of the invention The same. Finally, the steps may be performed in any suitable order, unless explicitly stated or contrary to the description of the steps constituting the method according to the invention. The present invention is not necessarily limited to the order of description of the above steps. The use of all examples or exemplary language (e.g., etc.) in this invention is for the purpose of describing the invention in detail and is not to be construed as a limitation on the scope of the invention, It is not. In addition, one of ordinary skill in the art appreciates that various modifications, combinations and changes can be made depending on design conditions and factors within the scope of the appended claims or equivalents thereof.

1A and 1B are views illustrating appearances of a front side and a rear side of a digital photographing apparatus 100 according to an exemplary embodiment.

FIG. 2 is a schematic block diagram of the digital photographing apparatus 100 shown in FIG. 1.

3 is a detailed block diagram of the digital signal processor 170 shown in FIG. 2.

4 is a flowchart illustrating a control method of a digital photographing apparatus according to another exemplary embodiment.

5A and 5B are exemplary diagrams for describing a function of composition determination of an input image.

6 is an exemplary view for explaining the function of the composition guide unit 174 shown in FIG.

7A to 7H are flowcharts illustrating a control method of a digital photographing apparatus according to another exemplary embodiment.

<Explanation of symbols for the main parts of the drawings>

100: digital photographing apparatus 164: first display unit

168: second display unit 170: digital signal processing unit

171: control unit 172: photo recognition unit

173: image synthesis unit 174: composition guide unit

Claims (19)

In the digital photographing apparatus provided with the 1st display part and the 2nd display part, The first display unit is provided at the rear of the digital photographing apparatus, and the second display unit is provided at the front of the digital photographing apparatus. And a digital signal processor configured to generate composition guide information based on reference composition information and an input image, and to display the generated composition guide information on the second display unit. The method of claim 1, The digital signal processing unit, A picture recognizing unit for extracting composition information of a sample picture as the reference composition information; An image synthesizer configured to synthesize the sample photo and the input image; A controller configured to generate composition guide information based on the composition information of the sample picture and the input image; And And a composition guide unit configured to display the generated composition guide information on the second display unit. The method of claim 2, The image synthesis unit, And synthesizing the contour of the subject of the sample picture with the input image. The method of claim 3, wherein The control unit, And a composition guide information indicating whether or not a subject coincides with the contour line in the input image. The method of claim 2, The composition guide information, And the match is expressed by color information. The method of claim 1, The reference composition information, Composition information extracted from the input image, The composition guide information, And the subject should be moved to match the subject of the input image with the reference composition information. The method of claim 2, The control unit, And the composition guide information is generated based on the composition information of the sample photograph and the input image according to whether the photographing is in a distance shooting or a near field shooting. The method of claim 2, The photo recognition unit, And extracting person information from the sample picture, reducing the size of the picture, or processing the picture into a front picture. The method of claim 1, The digital signal processing unit, And automatically photographing when the composition guide information displayed on the second display unit and the subject information of the input image match. In the control method of the digital photographing apparatus provided with the 1st display part and the 2nd display part, Generating reference composition information; Generating composition guide information based on the generated reference composition information and the input image; And And displaying the generated composition guide information on the second display unit. 11. The method of claim 10, The reference composition generating step, Extracting composition information of a predetermined sample picture; The composition guide information generating step, And synthesizing the sample photograph and the input image, and generating composition guide information based on the composition information of the sample photograph and the input image. The method of claim 11, And automatically photographing the composition guide information displayed on the second display unit and the subject of the input image. The method of claim 11, The synthesis step, And activating the contour of the subject of the sample picture and synthesizing it with the input image. The method of claim 13, The generating step, And controlling composition of the activated contour and the input image as composition guide information. The method of claim 11, The composition guide information, And the match is expressed by color information. 11. The method of claim 10, The reference composition information, Composition information extracted from the input image, The composition guide information, And the subject should be moved in order to match the subject of the input image with the reference composition information. The method of claim 11, Determining whether the image is a far shot or a near shot; The generating step, And a composition guide information is generated based on the composition information of the sample picture and the input image according to the determination result. The method of claim 11, The extraction step, And extracting person information from the sample picture, reducing the size of the picture, or processing the picture into a front picture. A recording medium having recorded thereon a program for executing a method according to any one of claims 10 to 18 on a computer.

Images