KR102149508B1 - Photographing apparatus, method for controlling the same, and computer-readable recording medium - Google Patents

Abstract

According to an aspect of an embodiment of the present invention, there is provided a method comprising: setting a first area according to a user input; Detecting an object of interest from the live view image; When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And outputting a sound guide according to the location of the main subject area and the location of the first area.

Description

Photographing apparatus, method for controlling the same, and computer-readable recording medium

Embodiments of the present invention relate to a photographing apparatus, a method of controlling a photographing apparatus, and a computer-readable recording medium.

Recently, shooting guide functions have been provided to help general users who are not familiar with shooting devices to easily take a desired picture. For example, a function that guides the composition of a picture in the photographing device is provided, so that a user can easily take a picture with a good composition. However, the photographing guide function has a problem in that a variable is generated according to a photographing situation, and thus an error is likely to occur.

Embodiments of the present invention are intended to allow a user to take self-portraits more conveniently.

In addition, embodiments of the present invention are for storing high-quality self-photographed images.

According to an aspect of an embodiment of the present invention,

Setting a first area according to a user input;

Detecting an object of interest from the live view image;

When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And

There is provided a method for controlling a photographing apparatus, including outputting a sound guide according to the location of the main subject area and the location of the first area.

The outputting of the sound guide may include outputting a first beep sound when the main subject area enters the first area; And outputting a second beep sound when the center of the main subject area enters the first area.

The method of controlling the photographing device further includes setting a second area within the first area, and the outputting of the sound guide includes: when the center of the main subject area enters the second area, 3 It may further include the step of outputting a beep sound.

The method of controlling the photographing device may further include displaying a border of the first area along with the live view image, and information on the second area may not be displayed.

The method of controlling the photographing apparatus may further include automatically photographing when a state in which the center of the main subject region is within the second region continues for a first reference time.

In the determining of the main subject, the main subject may be determined according to a location of the first area and a location of each of the plurality of subjects of interest.

Automatically continuously photographing when a state in which the center of the main subject area is within the first area continues for a first reference time; Temporarily storing the plurality of captured images continuously photographed; And storing at least one captured image selected by the user from among the plurality of consecutively captured captured images in a nonvolatile memory.

The method for controlling the photographing device includes: determining a recommended image from among the plurality of continuously photographed captured images; Generating a screen nail image of the recommended image; Generating a thumbnail image of each of the plurality of continuously photographed captured images; Displaying a screen nail image of the recommended image and a thumbnail image of each of the plurality of captured images together; Generating a screen nail image of the at least one captured image selected by the user when the at least one captured image selected by the user is an image different from the recommended image; And displaying a screen nail image of at least one captured image selected by the user instead of the screen nail image of the recommended image.

The method of controlling the photographing device further comprises post-processing the screen nail image of the recommended image and the screen nail image of at least one captured image selected by the user, and the screen nail image and the thumbnail of the recommended image Displaying the image together includes displaying a screen nail image of the post-processed recommended image and displaying a screen nail image of at least one captured image selected by the user, the post-processed user selected A screen nail image of at least one captured image may be displayed.

The storing of the at least one captured image selected by the user in a nonvolatile memory may include storing the post-processed screen nail image of the at least one captured image selected by the user together with the at least one captured image selected by the user. have.

The subject of interest is a face, and the method for controlling the photographing device may include determining whether a lens fastened to the photographing device is a lens capable of wide-angle photographing; And providing feedback to a user when the lens is not capable of wide-angle photographing.

The method of controlling the photographing device may include entering a self-photographing mode; And setting a photographing parameter of the photographing device to a wide-angle mode.

According to another aspect of an embodiment of the present invention,

A photographing unit that photoelectrically converts the incident light to generate a live view image;

A region of interest setting unit that sets a first region according to a user input;

An object of interest detector for detecting an object of interest from the live view image;

A main subject determining unit for determining a main subject among the plurality of subjects of interest when a plurality of subjects of interest are detected; And

There is provided a photographing apparatus including a sound guide output unit for outputting a sound guide according to the location of the main subject area and the location of the first area.

The sound guide output unit outputs a first beep sound when the main subject area enters the first area, and outputs a second beep sound when the center of the main subject area enters the first area can do.

The ROI setting unit may set a second area within the first area, and the sound guide output unit may output a third beep sound when the center of the main subject area enters the second area.

The photographing device may further include a display unit for displaying a border of the first area along with the live view image, and information on the second area may not be displayed on the display unit.

The photographing apparatus may further include an automatic photographing control unit that controls the photographing unit to automatically photograph when a state in which the center of the main subject region is within the second region continues for a first reference time.

The main subject determining unit may determine the main subject according to the position of the first area and the positions of the plurality of objects of interest.

The photographing unit automatically continuously photographs when a state in which the center of the main subject region is within the first region continues for a first reference time,

The photographing device includes: a volatile memory temporarily storing the plurality of captured images continuously photographed; And a nonvolatile memory for storing at least one captured image selected by a user from among a plurality of captured images continuously photographed.

The photographing apparatus may include: a recommended image determination unit configured to determine a recommended image from among a plurality of captured images continuously photographed; When a screen nail image of the recommended video is generated, a thumbnail image of each of the plurality of continuously photographed captured images is generated, and the at least one captured image selected by the user is an image different from the recommended video, the user An image processing unit generating a screen nail image of at least one selected captured image; When the screen nail image of the recommended image and the thumbnail image of each of the plurality of captured images are displayed together, and the at least one captured image selected by the user is a different image from the recommended image, instead of the screen nail image of the recommended image And a display unit for displaying a screen nail image of at least one captured image selected by the user.

The image processing unit post-processes the screen nail image of the recommended image and the screen nail image of at least one captured image selected by the user, and the display unit comprises: a screen nail image of the post-processed recommended image and the The post-processed screen nail image of at least one captured image selected by the user may be displayed.

The nonvolatile memory may store the post-processed screen nail image of at least one captured image selected by the user together with at least one captured image selected by the user.

The subject of interest is a face, and the photographing device further includes a lens confirmation unit that determines whether a lens fastened to the photographing device is a lens capable of wide-angle photographing, and provides feedback to a user when the lens is not capable of wide-angle photographing. can do.

The photographing device may further include a mode setting unit for entering a self-photographing mode and setting a photographing parameter of the photographing device to a wide-angle mode.

According to another aspect of an embodiment of the present invention, in a computer-readable recording medium that stores computer program codes for performing a method for controlling a photographing device when read and executed by a processor, the method for controlling a photographing device,

Setting a first area according to a user input;

Detecting an object of interest from the live view image;

When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And

A computer-readable recording medium is provided, comprising the step of outputting a sound guide according to the location of the main subject area and the location of the first area.

According to the embodiments of the present invention, there is an effect that a user can take a self-portrait more conveniently.

Further, according to embodiments of the present invention, there is an effect of storing a high-quality self-portrait image.

1 is a block diagram illustrating a structure of a photographing apparatus 100a according to an embodiment of the present invention.
2 is a diagram showing the structure of a photographing apparatus 100b according to an embodiment of the present invention.
3 is a diagram illustrating a first region R1 according to an exemplary embodiment of the present invention.
4 is a diagram for explaining a process of determining a main subject among a plurality of subjects of interest.
5 is a flowchart illustrating a method of controlling a photographing device according to an embodiment of the present invention.
6 is a diagram illustrating an operation of outputting a sound guide according to another embodiment of the present invention.
7 is a diagram illustrating a first beep sound, a second beep sound, and a third beep sound according to an embodiment of the present invention.
8 is a flow chart showing according to another embodiment of the present invention.
9 is a diagram showing the structure of a photographing apparatus 100c according to another embodiment of the present invention.
10 is a diagram illustrating a screen on which a first area R1 and a main subject area FD are displayed according to an embodiment of the present invention.
11 is a flowchart illustrating a method of controlling a photographing device according to another embodiment of the present invention.
12 is a diagram showing the structure of a photographing apparatus 100d according to another embodiment of the present invention.
13 is a diagram illustrating an image processing and storage process according to another embodiment of the present invention.
14 is a diagram illustrating a screen providing a screen nail image and a thumbnail image to a user according to another embodiment of the present invention.
15 is a diagram illustrating a process of processing and storing an image after continuous shooting according to another embodiment of the present invention.
16 is a diagram showing the structure of a photographing apparatus 100e according to another embodiment of the present invention.
17 is an example of a screen providing feedback that a lens is not appropriate according to another embodiment of the present invention.
18 is a diagram illustrating a process of setting a mode of a photographing apparatus according to another embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described later together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, and only these embodiments make the disclosure of the present invention complete, and are common knowledge in the art to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have, and the invention is only defined by the scope of the claims.

The terms used in the present specification will be briefly described, and the present invention will be described in detail.

The terms used in the present invention have been selected from general terms that are currently widely used while considering functions in the present invention, but this may vary depending on the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, the term "unit" used in the specification refers to a hardware component such as software, FPGA, or ASIC, and "unit" performs certain roles. However, "unit" is not meant to be limited to software or hardware. The “unit” may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors. Thus, as an example, "unit" refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, Includes subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables. The functions provided within the components and "units" may be combined into a smaller number of components and "units" or may be further separated into additional components and "units".

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present invention.

1 is a block diagram illustrating a structure of a photographing apparatus 100a according to an embodiment of the present invention.

The photographing apparatus 100a according to an embodiment of the present invention includes a photographing unit 110, an analog signal processing unit 120, a memory 130, a storage/reading control unit 140, a data storage unit 142, and a program storage unit. 150, a display driver 162, a display unit 164, a CPU/DSP 170, and an operation unit 180 may be included.

The overall operation of the photographing apparatus 100a is unified by the CPU/DSP 170. The CPU/DSP 170 provides control signals for the operation of each component to the lens driving unit 112, the aperture driving unit 115, the imaging device control unit 119, and the like.

The photographing unit 110 is a component that generates an image of an electrical signal from incident light, and includes a lens 111, a lens driving unit 112, a diaphragm 113, a diaphragm driving unit 115, an imaging device 118, and an imaging device. It includes an element control unit 119.

The lens 111 may include a plurality of groups and a plurality of lenses. The position of the lens 111 is adjusted by the lens driving unit 112. The lens driver 112 adjusts the position of the lens 111 according to a control signal provided from the CPU/DSP 170.

The degree of opening and closing of the stop 113 is controlled by the stop driving unit 115, and the amount of light incident on the imaging device 118 is controlled.

The optical signal transmitted through the lens 111 and the diaphragm 113 reaches the light-receiving surface of the imaging device 118 to form an image of the subject. The imaging device 118 may be a Charge Coupled Device (CCD) image sensor or a Complementary Metal Oxide Semiconductor Image Sensor (CIS) that converts an optical signal into an electrical signal. The sensitivity of the imaging device 118 may be adjusted by the imaging device controller 119. The imaging device controller 119 may control the imaging device 118 according to a control signal automatically generated by an image signal input in real time or a control signal manually input by a user's manipulation.

The exposure time of the imaging device 118 is controlled with a shutter (not shown). The shutter (not shown) includes a mechanical shutter that controls the incidence of light by moving a shade, and an electronic shutter that controls exposure by supplying an electric signal to the imaging device 118.

The analog signal processing unit 120 performs noise reduction processing, gain adjustment, waveform shaping, analog-digital conversion processing, and the like on the analog signal supplied from the imaging device 118.

The signal processed by the analog signal processing unit 120 may be input to the CPU/DSP 170 through the memory 130 or may be input to the CPU/DSP 170 without passing through the memory 130. Here, the memory 130 operates as a main memory of the photographing apparatus 100a, and temporarily stores information required during operation of the CPU/DSP 170. The program storage unit 130 stores programs such as an operating system and an application system that drive the photographing device 100a.

In addition, the photographing device 100a includes a display unit 164 to display the operation state thereof or image information captured by the photographing device 100a. The display unit 164 may provide visual information and/or audio information to a user. In order to provide visual information, the display unit 164 may include, for example, a liquid crystal display panel (LCD), an organic light emitting display panel, or the like. Also, the display unit 164 may be a touch screen capable of recognizing a touch input.

The display driver 162 provides a driving signal to the display unit 164.

The CPU/DSP 170 processes an input image signal and controls each component accordingly or according to an external input signal. The CPU/DSP 170 reduces noise for input image data, gamma correction, color filter array interpolation, color matrix, color correction, Image signal processing for image quality improvement, such as color enhancement, may be performed. In addition, an image file may be generated by compressing image data generated by processing an image signal for image quality improvement, or image data may be restored from the image file. The video compression format may be a reversible format or an irreversible format. As an example of a suitable format, it is also possible to convert a still image into a JPEG (Joint Photographic Experts Group) format or a JPEG 2000 format. In addition, when a moving picture is recorded, a moving picture file may be generated by compressing a plurality of frames according to the Moving Picture Experts Group (MPEG) standard. The image file may be generated according to the Exif (Exchangeable Image File Format) standard, for example.

The image data output from the CPU/DSP 170 is input through the memory 130 or directly to the storage/reading control unit 140, and the storage/reading control unit 140 automatically or automatically receives image data from the user. Is stored in the data storage unit 142. In addition, the storage/reading control unit 140 reads data related to the image from the image file stored in the data storage unit 142, inputs the data to the display driver through the memory 130 or through another path to the display unit 164. You can also have the image displayed. The data storage unit 142 may be detachable or may be permanently mounted on the photographing device 100a.

Further, the CPU/DSP 170 can perform blurring processing, color processing, blur processing, edge enhancement processing, image analysis processing, image recognition processing, and image effect processing. Face recognition, scene recognition processing, and the like can be performed by image recognition processing. In addition, the CPU/DSP 170 can process a display image signal for display on the display unit 164. For example, luminance level adjustment, color correction, contrast adjustment, outline enhancement adjustment, screen division processing, character image generation and image synthesis processing, and the like can be performed. The CPU/DSP 170 may be connected to an external monitor to process a predetermined image signal to be displayed on the external monitor, and transmit the processed image data to display the corresponding image on the external monitor.

In addition, the CPU/DSP 170 executes a program stored in the program storage unit 130 or has a separate module to generate a control signal for controlling auto focusing, zoom change, focus change, automatic exposure compensation, etc. , It is provided to the aperture driving unit 115, the lens driving unit 112, and the imaging device control unit 119, it is possible to collectively control the operation of components provided in the photographing apparatus 100a, such as a shutter and a strobe.

The manipulation unit 180 is a place where a user can input a control signal. The control unit 180 is a shutter-release button for inputting a shutter-release signal to take a picture by exposing the imaging device 118 to light for a predetermined period of time, and a power supply for inputting a control signal for controlling power on and off. Various function buttons, such as a button, a zoom button, a mode selection button, and other shooting setting value adjustment buttons, may be included to increase the angle of view or narrow the angle of view according to an input. The operation unit 180 may be implemented in any form in which a user can input a control signal, such as a button, a keyboard, a touch pad, a touch screen, and a remote controller.

It goes without saying that the photographing apparatus 100a illustrated in FIG. 1 is an embodiment of the present invention, and the photographing apparatus 100a according to embodiments of the present invention is not limited to the photographing apparatus 100a illustrated in FIG. 1. .

2 is a diagram showing the structure of a photographing apparatus 100b according to an embodiment of the present invention. The photographing apparatus 100b according to the present embodiment includes a photographing unit 210, a region of interest setting unit 220, an object of interest detection unit 230, a main subject determination unit 240, and a sound guide output unit 250 do.

For example, the region of interest setting unit 220, the object of interest detection unit 230, the main subject determination unit 240, and the sound guide output unit 250 are CPU/DSP of the photographing apparatus 100a of the embodiment of FIG. It may be provided in 170. The photographing unit 210 of the embodiment of FIG. 2 may correspond to the photographing unit 110 of the embodiment of FIG. 1. Of course, various other embodiments are also possible.

The photographing unit 210 photoelectrically converts the incident light to generate a live view image.

The region of interest setting unit 220 sets a first region according to a user input. The first area is an area where the user wants the main subject to be placed. According to an embodiment of the present invention, the user may directly set the location and size of an area where the main subject is desired to be placed. Accordingly, the main subject can be placed in various locations such as the center, right, and left of the screen, and the user can easily obtain a picture with a desired composition.

3 is a diagram illustrating a first region R1 according to an exemplary embodiment of the present invention.

According to an embodiment of the present invention, in the photographing area R3, the user may freely set the first area R1 in which the main subject is to be placed. As illustrated in FIG. 3, the first region R1 may be set to have a square shape. As another embodiment, the first region R1 may be set to a circle, an ellipse, or the like.

According to another embodiment of the present invention, the second area R2 may be set within the first area R1 set by the user. The second area R2 is an area that is automatically set by the ROI setting unit 220 and may be set to a predetermined size at the center of the first area R1, for example. The second region R2 may have the same shape as the first region R1 or may have a different shape. According to an embodiment, the second area R2 may be an area not visible to the user.

The region of interest setting unit 220 may provide a user interface that allows a user to set the first region R1. The user interface may be displayed through a display unit 164 (refer to FIG. 1) and a user input may be received through an operation unit 180 (refer to FIG. 1). When the display unit 164 is implemented as a touch screen, the ROI setting unit 220 may receive a user input through a touch input.

The object of interest detection unit 230 detects the object of interest from the live view image. According to an embodiment of the present invention, the subject of interest and the main subject may be faces. As another example, the subject of interest and the main subject may be a specific type of object such as a ball or a car.

As another example, it is possible for the user to set a subject of interest and a main subject. In this case, the object of interest detection unit 230 may detect the object of interest by tracking the object of interest set by the user in the live view image.

In the present specification, a case where the subject of interest and the main subject are faces will be described.

The object of interest detection unit 230 may use a face detection algorithm, an object detection algorithm, an object tracking algorithm, and the like to detect the object of interest.

When a plurality of subjects of interest are detected by the subject of interest detection unit 230, the main subject determination unit 240 determines a main subject among the plurality of subjects of interest.

4 is a diagram for explaining a process of determining a main subject among a plurality of subjects of interest.

When determining a main subject among a plurality of subjects of interest, the main subject determining unit 240 may determine the main subject in consideration of a distance between the center of each subject of interest and the center of the first region R1. For example, as shown in FIG. 4, when three face regions FD1, FD2, and FD3 are detected, each of the face regions FD1, FD2, and FD3 is recognized as a plurality of subjects of interest. At this time, based on the distance (d1, d2, d3) between the center of each face area (FD1, FD2, FD3) and the center of the first area (R1), the main subject among the three facial areas (FD1, FD2, FD3) Can be determined. According to an embodiment of the present invention, a subject of interest having the closest distance to the center of the first region R1 among a plurality of subjects of interest may be set as the main subject. Accordingly, in the case of FIG. 4, the face area FD2 of the second face having the closest distance between the center of the first area R1 and the center of the face area may be set as the main subject.

According to another embodiment of the present invention, when determining a main subject among a plurality of subjects of interest, the main subject determination unit 240, together with a distance between the center of each subject of interest and the center of the first region R1, You can also consider the size of the subject. The size of each subject of interest may be defined as, for example, the size of the face regions FD1, FD2, and FD3. According to the present embodiment, the main subject determining unit 240 applies a weight to each of the distance between the center of each subject of interest and the center of the first region R1, and the size of each subject of interest, and scores each subject of interest. The main subject can be determined based on the score.

According to still another embodiment of the present invention, the main subject determining unit 240 may set a subject of interest selected by a user among a plurality of subjects of interest as the main subject. In this case, the user may select a subject of interest to be set as a main subject from among subjects of interest detected by the subject of interest detection unit 230. For example, the main subject determining unit 240 displays the areas of the subjects of interest detected by the subject of interest detection unit 230 on the display unit 164, respectively, so that the user can select one of the subject areas of interest. Can provide.

The sound guide output unit 250 outputs a sound guide according to the location of the main subject area where the main subject is located and the location of the first area R1. For example, the sound guide output unit 250 may output different types of sound guides according to a distance between the center of the main subject area and the center of the first area R1. According to an embodiment of the present invention, the sound guide may be a beep sound.

According to another embodiment of the present invention, the sound guide output unit 250 considers whether the main subject area has entered the first area R1 and whether the main subject area has entered the second area R2. Sound guides can be provided.

5 is a flowchart illustrating a method of controlling a photographing device according to an embodiment of the present invention.

First, a first area R1 is set according to a user input (S502). The position and size of the first region R1 may be set according to a user input.

Next, a subject of interest is detected from the live view image (S504). According to an embodiment, the subject of interest may be a face. In this case, a face region may be detected from the live view image, and the face region may be displayed on the live view image.

If a plurality of subjects of interest are detected from the live view image (S506), the method according to the present embodiment determines a main subject from the plurality of subjects of interest (S508). According to an embodiment, the main subject may be determined in consideration of a distance between each subject of interest and the center of the first region R1, the size of the subject of interest, and the like. According to another embodiment, the main subject may be selected by a user.

If one subject of interest is detected (S506), the detected subject of interest is set as the main subject (S510).

When the main subject is determined (S508 and S510), a sound guide is output according to the location of the main subject area and the first area R1 (S512). For example, in the method for controlling the photographing apparatus according to the present exemplary embodiment, the sound guide may be output by varying the sound guide according to the distance between the center of the main subject area and the center of the first area R1.

According to another embodiment of the present invention, the second region R2 may be set in the first region R1. In this case, the sound guide may be output in consideration of whether the main subject area has entered the first area R1 and whether the main subject area has entered the second area R2.

6 is a diagram illustrating an operation of outputting a sound guide according to another embodiment of the present invention.

According to another embodiment of the present invention, the sound guide may vary according to the location of the main subject area FD, the location of the first area R1, and the location of the second area R2. According to the present embodiment, when the main subject area FD enters the first area R1, a first beep is output, and when the center of the main subject area FD enters the first area R1, a second beep sound is output. A beep sound is output, and when the center of the main subject area FD enters the second area R2, a third beep sound is output.

According to an embodiment, the first beep sound is output when the main subject area FD enters the first area R1, and the center of the main subject area FD enters the first area R1. A second beep sound is output at an instant, and a third beep sound is output when the center of the main subject area FD enters the second area R2.

According to another embodiment, while the main subject area FD is present in the first area R1, the first beep sound is output, and the center of the main subject area FD is in the first area R1. A second beep sound is output, and a third beep sound is output while the center of the main subject area FD is in the second area R2. The first beep sound, the second beep sound, and the third beep sound may be different types of beep sounds.

7 is a diagram illustrating a first beep sound, a second beep sound, and a third beep sound according to an embodiment of the present invention.

According to an embodiment, as shown in FIG. 7, a beep sound is output in a first cycle as a first beep sound, a beep sound is output in a second cycle as a second beep sound, and a third beep sound continues to beep. Sound can be output. The user may adjust the position of the photographing device 100b to take a resignation in a desired composition during self-photographing through a sound guide output as a different type of beep sound.

In addition to the beep sound, the sound guide may be output in various forms, such as a voice guide and a melody. In addition, the criterion for changing the beep sound may be variously determined according to exemplary embodiments.

8 is a flow chart showing according to another embodiment of the present invention.

When the main subject area FD enters the first area R1 (S702), a first beep sound is output (S704). If the center of the main subject area FD enters the first area R1 (S706), a second beep sound is output (S708). If the center of the main subject area FD enters the second area R2 (S710), a third beep sound is output (S712).

9 is a diagram showing the structure of a photographing apparatus 100c according to another embodiment of the present invention. The photographing apparatus 100c according to the present embodiment includes a photographing unit 210, a display unit 910, a region of interest setting unit 220, an object of interest detecting unit 230, a main subject determining unit 240, and a sound guide output unit ( 250), and an automatic photographing control unit 920.

For example, the region of interest setting unit 220, the subject of interest detection unit 230, the main subject determining unit 240, the sound guide output unit 250, and the automatic photographing control unit 920 are the photographing apparatus of the embodiment of FIG. It can be provided in the CPU/DSP 170 of (100a). The photographing unit 210 of the embodiment of FIG. 9 may correspond to the photographing unit 110 of the embodiment of FIG. 1. Of course, various other embodiments are also possible.

The photographing unit 210 photoelectrically converts the incident light to generate a live view image.

The region of interest setting unit 220 sets a first region according to a user input. The region of interest setting unit 220 may provide a user interface that allows a user to set the first region R1.

The object of interest detection unit 230 detects the object of interest from the live view image. According to an embodiment of the present invention, the subject of interest and the main subject may be faces.

When a plurality of subjects of interest are detected by the subject of interest detection unit 230, the main subject determination unit 240 determines a main subject among the plurality of subjects of interest.

The sound guide output unit 250 outputs a sound guide according to the location of the main subject area where the main subject is located and the location of the first area R1.

The display unit 910 displays the first area R1 and the main subject area FD together with the live view image. The first area R1 and the main subject area FD may be displayed, for example, by lines indicating the location and range of the corresponding area.

10 is a diagram illustrating a screen on which a first area R1 and a main subject area FD are displayed according to an embodiment of the present invention.

As illustrated in FIG. 10, the display unit 910 may display a first area R1 and a main subject area FD together with a live view screen for the photographing area R3. Even if the second region R2 is set together with the first region R1, information on the second region R2 may not be displayed on the display unit 910. However, an embodiment in which information on the second area R2 is displayed on the display unit 91 is also possible.

The display unit 910 may correspond to, for example, the display unit 164 of the embodiment illustrated in FIG. 1.

The automatic photographing control unit 920 determines whether the automatic photographing condition is satisfied, and performs automatic photographing when the automatic photographing condition is satisfied. The automatic photographing controller 920 controls the photographing unit 210 to perform automatic photographing.

According to an embodiment, the automatic photographing condition is when the center of the main subject area FD exists in the first area R1 for a first reference time. Accordingly, when the center of the main subject area FD exists in the first area R1 for the first reference time, automatic photographing is performed.

According to another embodiment, the automatic photographing condition is when the center of the main subject area FD exists in the second area R2 for a first reference time. Accordingly, when the center of the main subject area FD exists in the second area R2 for the first reference time, automatic photographing is performed.

11 is a flowchart illustrating a method of controlling a photographing device according to another embodiment of the present invention.

First, a first area R1 is set according to a user input (S1102). The position and size of the first region R1 may be set according to a user input.

Next, a subject of interest is detected from the live view image (S1104). According to an embodiment, the subject of interest may be a face. In this case, a face region may be detected from the live view image, and the face region may be displayed on the live view image.

If a plurality of subjects of interest are detected from the live view image (S1106), the method according to the present embodiment determines a main subject from the plurality of subjects of interest (S1108).

If one subject of interest is detected (S1106), the detected subject of interest is set as the main subject (S1110).

When the main subject is determined (S1108 and S1110), a sound guide is output according to the location of the main subject area and the location of the first area R1 (S1112).

If the main subject area exists in the first area R1 for the first reference time (S1114), automatic photographing is performed (S1116).

12 is a diagram showing the structure of a photographing apparatus 100d according to another embodiment of the present invention. The photographing apparatus 100d according to the present embodiment includes a photographing unit 210, a display unit 910, a volatile memory 1230, a nonvolatile memory 1240, a region of interest setting unit 220, an object of interest detection unit 230, A main subject determining unit 240, a sound guide output unit 250, an automatic photographing control unit 920, a recommended image determining unit 1210, and an image processing unit 1220 are included.

The photographing unit 210 photoelectrically converts the incident light to generate a live view image.

The region of interest setting unit 220 sets a first region according to a user input. The region of interest setting unit 220 may provide a user interface that allows a user to set the first region R1.

The object of interest detection unit 230 detects the object of interest from the live view image. According to an embodiment of the present invention, the subject of interest and the main subject may be faces.

When a plurality of subjects of interest are detected by the subject of interest detection unit 230, the main subject determination unit 240 determines a main subject among the plurality of subjects of interest.

The sound guide output unit 250 outputs a sound guide according to the location of the main subject area where the main subject is located and the location of the first area R1.

The display unit 910 displays the first area R1 and the main subject area FD together with the live view image.

The automatic photographing control unit 920 determines whether the automatic photographing condition is satisfied, and performs automatic photographing when the automatic photographing condition is satisfied. When the automatic photographing condition is satisfied, the automatic photographing controller 920 performs continuous photographing. The number of continuous shooting may be determined in advance or may be set by a user. A plurality of automatically captured captured images are temporarily stored in the volatile memory 1230.

The recommended image determiner 1210 determines a recommended image from among the plurality of automatically captured captured images. According to an embodiment, the recommended image may be determined based on face information and image quality information. The face information may include facial expression recognition and a degree of eye closing. The image quality information may include a contrast of a screen, information on a hand-shake during photographing, and the like.

The image processing unit 1220 generates a thumbnail image of each of the plurality of captured images, generates a screen nail image of the recommended image, and displays the thumbnail image and the screen nail image on the display unit 910. In addition, when an input for selecting at least one of the plurality of captured images is detected from the user, if at least one captured image selected by the user is a different image from the recommended image, a screen nail image is displayed for the captured image selected by the user. It is generated and displayed on the display unit 910.

According to an embodiment, the image processing unit 1220 performs post-processing on the recommended image and at least one captured image selected by the user. The post-processing may include, for example, at least one of facial color correction, blemishes correction, color tone correction, and contrast correction, or a combination thereof.

The volatile memory 1230 temporarily stores a plurality of captured images continuously photographed. The volatile memory 1230 may correspond to, for example, the memory 130 of the photographing apparatus 100a according to the embodiment of FIG. 1.

The nonvolatile memory 1240 stores an image selected by a user. The nonvolatile memory 1240 may correspond to, for example, the data storage unit 142 of the photographing apparatus 100a according to the embodiment of FIG. 1. The nonvolatile memory 1240 may be implemented in the form of, for example, an SD card or a flash memory.

13 is a diagram illustrating an image processing and storage process according to another embodiment of the present invention.

According to the present embodiment, the image processing unit 1220 may post-process an image whose scale is down to a screen nail image, thereby reducing the amount of image processing. In addition, the amount of image processing can be reduced by performing post-processing only on the recommended video and the video selected by the user. Also, since only the image selected by the user is moved from the volatile memory 1230 to the nonvolatile memory 1240 and stored, and the unselected image is not stored, it is possible to prevent unnecessary images from being stored. Furthermore, in order to provide feedback on shooting to the user, a screen nail image is generated for the image selected by the user, post-processed, and then reused when the post-processed screen nail image is stored in the nonvolatile memory 1240. Thus, the efficiency of image processing can be increased.

14 is a diagram illustrating a screen providing a screen nail image and a thumbnail image to a user according to another embodiment of the present invention.

According to this embodiment, a screen nail image SN of a recommended image or a user-selected image is displayed. In addition, thumbnail images TN of a plurality of captured images continuously photographed are displayed together with the screen nail image SN. The user can select an image to be saved by selecting one of the thumbnail images TN. When continuous shooting is performed, a screen nail image TN of a recommended image and a thumbnail image TN of a plurality of captured images are initially displayed together. Thereafter, when the user selects a captured image different from the recommended image, a screen nail image (TN) for the selected captured image is generated and post-processed, so that the screen nail image (TN) for the selected captured image is converted to the screen nail of the recommended image. It may be displayed instead of the image TN.

15 is a diagram illustrating a process of processing and storing an image after continuous shooting according to another embodiment of the present invention.

When the automatic photographing condition is satisfied and continuous photographing is performed (S1502), a recommended image is determined from among a plurality of captured images continuously photographed (S1504). Next, a screen nail image of the recommended image is generated, and the screen nail image is post-processed (S1506).

In addition, thumbnail images of continuously photographed captured images are generated (S1508).

Next, a screen nail image of the recommended image and a thumbnail image of a plurality of consecutively photographed captured images are displayed together (S1510). A user selection of selecting at least one of thumbnail images for a plurality of captured images is received (S1512). If the user selects a captured image different from the recommended image (S1514), a screen nail image of the image selected by the user is generated and post-processed (S1516). In addition, the screen nail image of the image selected by the user is displayed instead of the screen nail image of the recommended image.

Next, the captured image selected by the user is stored in the nonvolatile memory (S1518). Captured images that are not selected by the user are not stored in the nonvolatile memory and are deleted.

16 is a diagram showing the structure of a photographing apparatus 100e according to another embodiment of the present invention. The photographing apparatus 100e according to the present embodiment includes a photographing unit 210, a mode setting unit 1610, a lens checking unit 1620, a region of interest setting unit 220, an object of interest detection unit 230, and a main subject determining unit. (240), and a sound guide output unit 250 may be included.

For example, the region of interest setting unit 220, the object of interest detection unit 230, the main subject determination unit 240, the sound guide output unit 250, the mode setting unit 1610, and the lens confirmation unit 1620 It may be provided in the CPU/DSP 170 of the photographing apparatus 100a of the embodiment of FIG. 1. The photographing unit 210 of the embodiment of FIG. 16 may correspond to the photographing unit 110 of the embodiment of FIG. 1. Of course, various other embodiments are also possible.

The photographing unit 210 photoelectrically converts the incident light to generate a live view image.

The region of interest setting unit 220 sets a first region according to a user input. The region of interest setting unit 220 may provide a user interface that allows a user to set the first region R1.

The object of interest detection unit 230 detects the object of interest from the live view image. According to an embodiment of the present invention, the subject of interest and the main subject may be faces.

When a plurality of subjects of interest are detected by the subject of interest detection unit 230, the main subject determination unit 240 determines a main subject among the plurality of subjects of interest.

The sound guide output unit 250 outputs a sound guide according to the location of the main subject area where the main subject is located and the location of the first area R1.

The mode setting unit 1610 enters the self-photographing mode and sets a photographing parameter of the photographing apparatus 100e to a wide-angle mode. The mode setting unit 1610 may enter a self-portrait mode or automatically enter a self-portrait mode according to a user input. In the case of self-photographing, you must shoot in the wide-angle mode to focus on the face of a nearby subject. Accordingly, when entering the self-photographing mode, the mode setting unit 1610 automatically sets the photographing parameters to values for wide-angle photographing. For example, in the wide-angle mode, the focal length may be shortened and the aperture value may be set to decrease.

When the lens check unit 1620 enters the self-photographing mode, it checks whether self-photographing is possible with a lens fastened to the photographing apparatus 100e. If self-photographing is not possible with the lens fastened to the photographing apparatus 100e, feedback that the lens is not appropriate is provided to the user. Here, whether self-photographing is possible, whether or not a lens fastened to the imaging device 100e can shoot in a wide-angle mode is determined whether a lens fastened to the imaging device 100e can have a focal length of a predetermined range, a predetermined It may be determined based on whether or not it can have a range of aperture values. In the case of self-portrait, it is appropriate to take a picture in a wide-angle mode, and the focal length and aperture value range may be set to a range corresponding to the wide-angle mode. When the photographing apparatus 100e is implemented in an interchangeable lens type, when a user receives feedback that the lens is not appropriate, the user may perform self-photographing by replacing the lens.

17 is an example of a screen providing feedback that a lens is not appropriate according to another embodiment of the present invention.

As illustrated in FIG. 17, when the lens is not suitable for self-photographing, the lens confirmation unit 1620 may provide feedback that self-photographing is difficult on the live view screen. Feedback that the lens is not appropriate can be provided in various forms, such as voice guide, beep guide, and LED lamp lighting.

18 is a diagram illustrating a process of setting a mode of a photographing apparatus according to another embodiment of the present invention.

First, when the self-photographing mode is entered (S1802), the photographing apparatus 100e enters the wide-angle mode (S1804). If it is not suitable for wide-angle mode shooting (S1806), a feedback that the lens is not suitable is provided to the user (S1808).

Meanwhile, the present invention can be implemented by storing a computer-readable code in a computer-readable storage medium. The computer-readable storage medium includes all types of storage devices storing data that can be read by a computer system.

When the computer-readable code is read and executed by a processor from the computer-readable storage medium, the computer-readable code is configured to perform steps of implementing the method for controlling a photographing apparatus according to the present invention. The computer-readable code may be implemented in various programming languages. In addition, functional programs, codes, and code segments for implementing the embodiments of the present invention can be easily programmed by those of ordinary skill in the art to which the present invention belongs.

Examples of computer-readable storage media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, and the like, and also include those implemented in the form of carrier waves (for example, transmission through the Internet). Further, the computer-readable storage medium may be distributed over a computer system connected by a network, and computer-readable codes may be stored and executed in a distributed manner.

Although the embodiments of the present invention have been described with reference to the above and the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features You can understand that there is. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting.

Claims (25)

delete Setting a first area according to a user input;
Detecting an object of interest from the live view image;
When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And
And outputting a sound guide according to the location of the main subject area and the location of the first area,
The step of outputting the sound guide,
Outputting a first beep sound when the main subject area enters the first area; And
And outputting a second beep sound when the center of the main subject area enters the first area. The method of claim 2,
The method for controlling the photographing device further includes setting a second area within the first area,
The step of outputting the sound guide,
And outputting a third beep sound when the center of the main subject area enters the second area. The method of claim 3,
The method for controlling the photographing device further comprises displaying a border of the first area together with the live view image,
Information on the second area is not displayed, the photographing device control method. The method of claim 3,
The method of controlling a photographing apparatus further comprising the step of automatically photographing when a state in which the center of the main subject region is within the second region continues for a first reference time. The method of claim 2,
The determining of the main subject comprises determining the main subject according to a location of the first area and a location of each of the plurality of subjects of interest. Setting a first area according to a user input;
Detecting an object of interest from the live view image;
When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And
Outputting a sound guide according to the location of the main subject area and the location of the first area; When the state in which the center of the main subject area is within the first area continues for a first reference time, automatically continuous Photographing;
Temporarily storing the plurality of captured images continuously photographed; And
And storing at least one captured image selected by a user from among a plurality of captured images continuously photographed in a nonvolatile memory. The method of claim 7,
Determining a recommended image from among the plurality of continuously photographed captured images;
Generating a screen nail image of the recommended image;
Generating a thumbnail image of each of the plurality of continuously photographed captured images;
Displaying a screen nail image of the recommended image and a thumbnail image of each of the plurality of captured images together;
When at least one captured image selected by the user is a different image from the recommended image,
Generating a screen nail image of at least one captured image selected by the user; And
Instead of the screen nail image of the recommended video, displaying a screen nail image of at least one captured image selected by the user. The method of claim 8,
The method of controlling the photographing device further includes post-processing the screen nail image of the recommended image and the screen nail image of at least one captured image selected by the user,
The displaying of the screen nail image and the thumbnail image of the recommended image together includes displaying the screen nail image of the post-processed recommended image,
The displaying of the screen nail image of the at least one captured image selected by the user comprises displaying a screen nail image of the at least one captured image selected by the user after the post-processing. The method of claim 9,
The storing of the at least one captured image selected by the user in a nonvolatile memory includes storing the post-processed screen nail image of the at least one captured image selected by the user together with the at least one captured image selected by the user. , Shooting device control method. In the photographing device control method,
Setting a first area according to a user input;
Detecting an object of interest from the live view image;
When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And
And outputting a sound guide according to the location of the main subject area and the location of the first area,
The subject of interest is a face,
The method for controlling the photographing device,
Determining whether the lens fastened to the photographing device is a lens capable of wide-angle photographing; And
When the lens is not capable of wide-angle photographing, the method further comprising providing a feedback to the user. Setting a first area according to a user input;
Detecting an object of interest from the live view image;
When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And
Outputting a sound guide according to the location of the main subject area and the location of the first area; entering a self-photographing mode; And
A method for controlling a photographing device, comprising setting a photographing parameter of the photographing device to a wide-angle mode. delete A photographing unit that photoelectrically converts the incident light to generate a live view image;
A region of interest setting unit that sets a first region according to a user input;
An object of interest detector for detecting an object of interest from the live view image;
A main subject determining unit for determining a main subject among the plurality of subjects of interest when a plurality of subjects of interest are detected; And
A sound guide output unit for outputting a sound guide according to the location of the main subject area and the location of the first area,
The sound guide output unit outputs a first beep sound when the main subject area enters the first area, and outputs a second beep sound when the center of the main subject area enters the first area To do, the shooting device. The method of claim 14,
The ROI setting unit sets a second area in the first area,
The sound guide output unit outputs a third beep sound when the center of the main subject area enters the second area. The method of claim 15,
The photographing device further includes a display unit for displaying a border of the first area together with the live view image,
Information on the second area is not displayed on the display unit, photographing apparatus. The method of claim 15,
The photographing apparatus further comprises an automatic photographing control unit configured to control the photographing unit to automatically photograph when a state in which the center of the main subject region is within the second region continues for a first reference time. The method of claim 14,
The main subject determining unit is configured to determine the main subject according to the position of the first area and the positions of the plurality of objects of interest. In the photographing device,
A photographing unit that photoelectrically converts the incident light to generate a live view image;
A region of interest setting unit that sets a first region according to a user input;
An object of interest detector for detecting an object of interest from the live view image;
A main subject determining unit for determining a main subject among the plurality of subjects of interest when a plurality of subjects of interest are detected; And
A sound guide output unit for outputting a sound guide according to the location of the main subject area and the location of the first area,
The photographing unit automatically continuously photographs when a state in which the center of the main subject region is within the first region continues for a first reference time,
The photographing device,
A volatile memory temporarily storing the plurality of continuously photographed captured images; And
A photographing apparatus further comprising a nonvolatile memory for storing at least one captured image selected by a user from among a plurality of continuously photographed captured images. The method of claim 19, wherein the photographing device,
A recommended image determination unit that determines a recommended image from among the plurality of consecutively photographed captured images;
When a screen nail image of the recommended video is generated, a thumbnail image of each of the plurality of continuously photographed captured images is generated, and the at least one captured image selected by the user is an image different from the recommended video, the user An image processing unit generating a screen nail image of at least one selected captured image;
When the screen nail image of the recommended image and the thumbnail image of each of the plurality of captured images are displayed together, and the at least one captured image selected by the user is a different image from the recommended image, instead of the screen nail image of the recommended image And a display unit for displaying a screen nail image of at least one captured image selected by the user. The method of claim 20,
The image processing unit post-processes a screen nail image of the recommended image and a screen nail image of at least one captured image selected by the user,
The display unit displays a screen nail image of the post-processed recommended image and a screen nail image of the post-processed at least one captured image selected by the user. The method of claim 21,
The nonvolatile memory, wherein the post-processed screen nail image of the at least one captured image selected by the user is stored together with the at least one captured image selected by the user. In the photographing device,
A photographing unit that photoelectrically converts the incident light to generate a live view image;
A region of interest setting unit that sets a first region according to a user input;
An object of interest detector for detecting an object of interest from the live view image;
A main subject determining unit for determining a main subject among the plurality of subjects of interest when a plurality of subjects of interest are detected; And
A sound guide output unit for outputting a sound guide according to the location of the main subject area and the location of the first area,
The subject of interest is a face,
The photographing apparatus further comprises a lens confirmation unit that determines whether a lens fastened to the photographing apparatus is a lens capable of wide-angle photographing, and provides feedback to a user when the lens is not capable of wide-angle photographing. A photographing unit that photoelectrically converts the incident light to generate a live view image;
A region of interest setting unit that sets a first region according to a user input;
An object of interest detector for detecting an object of interest from the live view image;
A main subject determining unit for determining a main subject among the plurality of subjects of interest when a plurality of subjects of interest are detected;
A sound guide output unit for outputting a sound guide according to the location of the main subject area and the location of the first area; And
A photographing apparatus comprising a mode setting unit that enters the self photographing mode and sets photographing parameters of the photographing apparatus to a wide-angle mode. A computer readable recording medium storing computer program codes for performing a method for controlling a photographing device when read and executed by a processor, wherein the method for controlling a photographing device comprises:
Setting a first area according to a user input;
Detecting an object of interest from the live view image;
When a plurality of subjects of interest are detected, determining a main subject from among the plurality of subjects of interest; And
And outputting a sound guide according to the location of the main subject area and the location of the first area,
The step of outputting the sound guide,
Outputting a first beep sound when the main subject area enters the first area; And
And outputting a second beep sound when the center of the main subject area enters the first area.

Images