KR20100118888A - Photographing apparatus and method of displaying subject - Google Patents

Abstract

PURPOSE: A photographing apparatus and a method of displaying a subject for conveniently confirming contents of various elements are provided to conveniently confirm the specific element for displaying a live-view image. CONSTITUTION: A photographing unit generates an image data displaying an image by photographing a photographing object. A reference setting unit(45) sets up a reference selecting a confirming area for photographing the photographing object. A live view generating unit(70) extracts the image data from the confirmation area satisfying the fixed the standards in the reference setting unit.

Description

Photographing apparatus and method of displaying subject}

The present invention relates to a photographing apparatus and a method for displaying a photographing target, and more particularly, a live view image obtained by synthesizing a partial image and an entire image of an image to be checked for photographing at a photographing target is displayed, and thus is intended for a user. The present invention relates to a photographing apparatus and a method of displaying a photographing target, in which details of various elements can be conveniently confirmed.

Photographing devices having an image pickup device such as a digital camera or a phone camera have a live view function of showing a user's subject in real time to a user in real time. The live view function checks the image quality of the image to be photographed immediately before shooting.

Recently, a live view function widely implemented in a digital camera is a method of providing a user with a screen before shooting in real time by using an image pickup device mounted in the digital camera to perform a shooting function without using a separate optical viewfinder. As a result, the user can check in advance the actual live view screen close to the image to be photographed.

However, the live view function provided in the conventional photographing apparatus as described above had inconveniences in use due to the size limitation of the display of the digital camera. For example, when photographing a person against a landscape, the user must check several important factors immediately before performing a shoot, such as the person's position in the scenery, the person's facial expression, or the focusing state of the person's face area. . However, since the size of the mounted display is small, it is impossible to check the overall composition of the screen to be photographed and to check the focus adjustment state of the face area of the person because the digital display manufactured to be small is easy to carry. .

The factor that focuses on the user's shooting is not limited to the focus adjustment state for the face of the person. For example, as described above, the user may have various factors such as the composition of the screen such as the relationship of the position of the person with respect to the background, the expression change such as when the person smiles, the movement of a specific subject, or the exposure state information of the specific area. The shooting is finally decided when the user's intention is met.

Conventional digital cameras have a function of automatically recognizing a face to perform focus adjustment on the recognized face, and displaying a rectangular box on an area of the recognized face in a live view screen state. Digital cameras equipped with these features have the advantage of making portraits more convenient, but have not been able to meet the various needs of users who want to quickly determine whether various factors have met their intentions and decide to execute shooting. In other words, the live view screen of a conventional digital camera displays only the entire image to be shot and there is no way to check whether some areas of the entire image meet the shooting intention. There was a problem of missing a picture or missing the timing of proper shooting.

An object of the present invention is to provide a photographing apparatus having an improved live view function.

Another object of the present invention is to provide a method for displaying a shooting target, which enables a user to conveniently check various elements belonging to a shooting intention through a live view screen which provides a real-time view of a shooting target.

It is still another object of the present invention to provide a photographing apparatus and a method of displaying a photographing object, which enable convenient and efficient photographing by displaying various factors and regions of interest when the photographing is performed on a live view screen.

The present invention provides a photographing apparatus and a photographing target display method capable of displaying a live view image obtained by synthesizing a partial image of a region to be checked for photographing from a photographing subject and an entire image of the image.

The photographing apparatus according to the present invention includes an image capturing unit for capturing a photographing target at predetermined intervals to generate image data representing an image, a reference setting unit for setting a criterion for selecting regions to be checked for photographing at the photographing target, and an image. A live view generation unit that extracts a partial image from a confirmation area that meets the criteria set in the reference setting unit in the image represented by the data, and generates a live view image obtained by combining the partial image and the entire image including the entire image represented by the image data. And a display unit for outputting a live view image.

In the present invention, the photographing apparatus may further include a person detector that detects a person from the image data, and the reference setting unit may include a face area of the person detected by the person detector.

In the present invention, the photographing apparatus may further include a focus adjusting unit that automatically adjusts focus by defining a focus area in the image of the image data, and the reference setting unit may include a focus area determined by the focus adjusting unit in the area to be checked. have.

In the present invention, the photographing apparatus may further include a user input unit that receives a user input, and the reference setting unit may include a user designation area designated by the user input unit in the area to be checked.

In the present invention, the photographing apparatus may further include a motion detecting unit for detecting a movement of the subject present in the user designated area, and the reference setting unit may include the region in which the subject exists.

The photographing target display method according to the present invention includes a reference setting step of setting a criterion for selecting regions to be checked for photographing, an imaging step of photographing a photographing target to generate image data representing an image, and an image represented by the image data. A live view generation step of extracting a partial image from a confirmation region that meets the criteria set in the reference setting step and generating a live view image obtained by synthesizing the entire image including the entire image represented by the partial image and the image data; The display step of outputting.

As described above, the photographing apparatus and the method of displaying a photographing target of the present invention display a live view image obtained by synthesizing a partial image of a region to be checked for photographing and an entire image of the image in the photographing target, and thus, the user intends to capture various images. You can conveniently check the details of these four elements.

Hereinafter, the configuration and operation of the photographing apparatus and the photographing target display method according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram schematically illustrating a relationship between components of a photographing apparatus according to an exemplary embodiment of the present invention.

The imaging apparatus according to the embodiment shown in FIG. 1 includes an image capturing unit 3 for capturing a photographing target to generate image data representing an image, and a live view generating unit 70 for generating a live view image from an image represented by the image data. ), A display unit 51 for outputting a live image, and a reference setting unit 45 for defining a criterion for selecting regions to be checked for photographing.

The photographing apparatus having such a configuration processes the live view image representing the photographing target in real time through the image capturing unit 3 and displays it on the display unit 51, thereby providing a live view function for confirming the photographing target for performing photographing. Can be provided to the user.

The imaging unit 3 captures an image of an image pickup object 20 for converting an image of a subject into an electrical signal, an optical system 10 disposed in front of the image pickup device 20, and an electrical signal from the image pickup device 20. An image conversion unit 41 for converting the data is provided.

The optical system 10 disposed in front of the image pickup device 20 includes a plurality of lenses 12 to perform the function of imaging external image light on the image pickup surface of the image pickup device 20. The lenses 12 are arranged to be variable in distance from each other. When the distance between the lenses 12 is changed, the zoom magnification and the focus of the optical system 10 may be adjusted.

The lenses 12 are driven by the zoom driver 11 having a driving means such as a zoom motor, so that positions thereof with respect to each other may be varied. The lenses 12 may include a zoom lens that enlarges or reduces the size of the subject and a focus lens that adjusts the focus of the subject. The zoom driver 11 is operated by receiving a control signal from the driving circuit unit 42 of the controller 40. Accordingly, the zoom driver 11 may drive the optical system 10 such that the optical system 10 has any one of a plurality of magnifications.

The imaging device 20 includes a photoelectric conversion device such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and the image light incident through the optical system 10 is an image that is an electrical signal. Convert to a signal. The process of converting image light into an electrical signal includes first converting an analog signal, converting an analog signal to a digital signal, pixel defect correction, gain correction, white balance correction, gamma correction, and the like for the digital signal. It can be made up of detailed steps such as signal processing.

The image conversion unit 41 converts the electrical signal of the image pickup device 20 into image data capable of performing image processing. The image data generated by the image converter 41 may be stored in the memory 15 and used by the live view generator 70, the face detector 49, the motion detector 46, and the like.

When the image capturing unit 3 generates image data by capturing image light of an object to be photographed, it can be divided into two cases. That is, when the user finally takes a picture by pressing the shutter, the imaging unit 3 operates to generate an image having the best resolution, and generates a live view image that can be displayed on the display unit 51 until the shutter is pressed. It works. In general, since the resolution of the display unit 51 is lower than the maximum resolution that the photographing apparatus can capture and record, the image pickup unit 3 has a relatively low resolution when the image capturing unit 3 performs an image capturing operation to generate a live view image. Perform an operation to create an image.

In addition, while the photographing apparatus performs the live view function, the image of the subject to be photographed must be processed and displayed on the display unit 51 in real time, so that the image capturing unit 3 captures the subject to be photographed at predetermined intervals to generate image data. Repeat the operation.

The controller 40 is electrically connected to the image pickup device 20, the zoom driver 11, the touch screen 50, and the like, and transmits and receives control signals or data to these components to control the operation of each component. It performs functions such as processing. The control unit 40 includes an image conversion unit 41, a driving circuit unit 42, a touch screen control unit 44, a memory control unit 43 that controls data storage for the memory 15, and a shooting control unit 47. ), A reference setting unit 45, a face detector 49, a focus adjuster 48, a motion detector 46, a live view generator 70, and the like.

The controller 40 may be implemented as a microchip or a circuit board including the microchip, and each component included in the controller 40 may be implemented by software or circuits included in the controller 40. .

The memory control section 43 controls the recording of the image data to the memory 15 and the reading of the image data and setting information recorded in the memory 15. The memory 15 is made of, for example, a semiconductor memory element such as SDRAM (synchronous DRAM) to store data of a captured image.

The photographing apparatus may include a touch screen 50 having a display unit 51 for displaying an image of image data and an input unit 52 for selecting a portion of the image displayed on the display unit 51. The touch screen 50 performs a function of displaying an image captured by the imaging device 20 and a function of sensing a touch on a surface and generating a signal corresponding to the detected position.

The touch screen 50 is an input device that replaces a keyboard and a mouse. Since the touch screen 50 can be directly touched with a hand or a pen to perform a desired task, an intuitive task can be performed under a graphical user interface (GUI) environment. It is a device that lets you. As the display unit 51 of the touch screen 50, a display device such as a liquid crystal display (LCD) or an organic light emitting diode (OLED) may be used.

The input unit 52 is installed on the surface of the display unit 51 to sense a touch of the surface, and is an example of a user input unit provided in the photographing apparatus of the present invention. The input unit 52 may use various types of technologies such as resistive sensing means, capacitive sensing means, surface acoustic wave use sensing means, infrared (IR) use sensing means, and optical use sensing means.

By touching the input unit 52 of the touch screen 50, the user may select and execute a menu from a portion of the image displayed on the display unit 51 or designate a confirmation area.

The configuration for the user input unit is not limited only by the touch screen 50, and may be implemented in various forms. For example, when an image is displayed on the display unit 51, the user may designate a confirmation area by operating another type of user input unit (not shown) such as a menu button or a dial provided in the photographing apparatus.

When the imaging device 20 captures a photographing target to generate an electrical signal, and the electrical signal is converted into image data by the image conversion unit 41, the live view generation unit 70 processes the image data. A live view image that can be displayed on the display unit 51 is generated. The live view generation unit 70 generates a live view image by combining the entire image including the entire image represented by the image data and the partial image representing a part of the image.

The partial image used by the live view generating unit 70 to generate the live view image is extracted from a partial region of the image represented by the image data, and a partial region of the image from which the partial image is extracted is referred to as a 'confirmation region' below. Call. The confirmation area is not fixed to a specific area of the image but is an area that is selected according to a predetermined criterion.

The reference setting unit 45 performs a function of setting a reference for selecting confirmation areas from which the partial image is extracted. The confirmation areas may be areas to be checked for shooting in the photographing target.

FIG. 2 is an operating state diagram illustrating an operation of setting a criterion for selecting a confirmation region using the photographing apparatus of FIG. 1.

For example, when a user who takes a picture using a photographing device wants to check details of the focus, brightness, or facial expression of the face areas of the person to be photographed, the face areas of the person may be set as the confirmation area. have. In order to select such a function, the face recognition menu 121 may be selected from the confirmation area reference setting menu 120 displayed on the touch screen 50.

Also, for example, when the user wants to check the focus area where the photographing apparatus has adjusted the focus to perform shooting, the focus area may be the confirmation area by selecting the focus area menu 122. In addition, when the user wants to freely designate and check a partial area of the entire screen, the user area menu 123 may be selected and a partial area 91a of the entire image 91 may be designated. In this case, the partial area 91a designated by the user may be the confirmation area.

The user may change the size and position of the box displayed on the touch screen 50 by dragging the touch. Drag touch refers to a touch method for moving a predetermined distance along the surface of the touch screen. When the user's selection operation is completed, the area 91a existing inside the box is set as the confirmation area.

The reference setting unit 45 may display a menu for setting a reference for selecting a confirmation area on the display unit 51, and may predetermine a confirmation area selection criterion from a menu selected by the user. In the present embodiment, as a criterion for selecting the confirmation region, the 'face recognition mode', the 'focus area mode' and the 'user area mode' are described as examples.

The face detector 49 may recognize the faces of people included in the image from the image data. The face detector 49 may include a face detection circuit that detects face regions corresponding to faces of a person from image data captured for generating a live view image.

Various known methods for detecting a face of a person may be used in the face detection circuit. For example, face recognition techniques using standard facial geometric features stored in database 60 may be used. Face recognition using geometric features is a technique for recognizing faces of individual individuals using geometric factors such as the location, size and distance between facial feature points such as eyes, nose and mouth.

The focus adjusting unit 48 functions to determine a focus area for the subject from the image data, and then detect the focus in the image and adjust the focus. The focus adjusting unit 48 may include an AF (auto focusing) detection circuit. Determining the focus area with respect to the subject by the focus adjusting unit 48 may be implemented in various ways. For example, when a user designates a portion of an area of the screen, the designated portion may be set as the focus region. In addition, one of the face areas detected by the face detection circuit may be defined as the focus area, or the focus area may be automatically determined by various methods predetermined by the AF detection circuit.

When the focus adjuster 48 detects a focus position with respect to the focus area, a conventionally known focusing technique may be used. The detection of the focus position can be performed by, for example, driving a focus lens to obtain a focus evaluation value (AF evaluation value). In other words, the focus position is calculated by moving the focus lens to extract high frequency components in the image signal and integrating the extracted signal. The AF evaluation value is composed of a curve having one maximum value, and the position of the focus lens at which the AF evaluation value is maximum can be regarded as the focus position.

The motion detector 46 detects a change in the subject appearing in the image data and tracks the motion trajectory of the subject. In the operation example illustrated in FIG. 2 by the reference setting unit 45, the area change mode menu 130 for changing the user area when the user is designated as the 'user area mode' is a function for recognizing an operation. Alternatively, any one function of the region fixing menu 131 for fixing the user region to a specific portion may be selected.

When selected as a function of 'motion recognition' in the 'user area mode', the motion detector 46 may change the confirmation area 91a by tracking the motion trajectory of the subject 91b. That is, the live view generator 70 may change the confirmation area for extracting the partial image into an area where the subject currently exists, based on the signal of the motion detector 46 that detects the movement of the subject.

3 is a block diagram schematically illustrating components of a live view generating unit of the photographing apparatus of FIG. 1.

The live view generation unit 70 includes a confirmation area setting unit 71 that sets a confirmation area based on the criteria determined by the reference setting unit 45, and a confirmation area that satisfies the criteria set in the reference setting unit 45. And a partial image extracting unit 72 for extracting a partial image from the image, and an image synthesizing unit 73 for synthesizing the partial image and the whole image.

4 is a flowchart illustrating steps of a photographing target display method according to an exemplary embodiment of the present invention.

The photographing target display method shown in FIG. 4 includes a reference setting step (S100) of setting a criterion for selecting areas to be checked for photographing, an imaging step (S110) of photographing a photographing target to generate image data representing an image; A live view generating step (S130, S140, S150, S160) of generating a live view image including a partial image and an entire image of the confirmation area, and a display step (S165) of displaying a live view image.

In the reference setting step S100, a criterion for selecting areas to be checked for capturing in an image representing a photographing target may be set in advance. If the user wants to check the face part of the person in detail before shooting, the face areas may be the confirmation area, and if the user wants to check the focus area in detail, the focus area may be the confirmation area. In addition, a partial region selected by the user in the image representing the photographing target may be a confirmation region.

The imaging step (S110) is a step of capturing an image for live view, and the imaging device performs imaging so as to generate an image suitable for the resolution of the display unit. In addition, in order to display the live view image, the image of the current photographing target must be processed in real time and repeatedly displayed, and the imaging device repeatedly performs the imaging operation at predetermined intervals.

After the imaging step S110, the primary live view display step S120 of displaying the entire image including the entire captured image may be performed.

FIG. 5 is an operational state diagram illustrating a photographing operation using the photographing apparatus of FIG. 1, and an example of a primary live view display has been described.

The user may set the overall composition for capturing through the entire image 95 displayed on the touch screen 50 of the photographing apparatus 1 by executing the first live view display step S120. When the user wants to perform shooting with the entire image 95 as shown in FIG. 5, the user can perform a half pressing operation (executing S1) by pressing the shutter button 5 halfway. The photographing apparatus checks whether S1 has been executed (S130), and if S1 has not been executed, executes steps S110 and S120 again.

When the half pressing operation S1 is executed, step S140 of selecting a confirmation area is executed. The confirmation area is an area to be checked for shooting at the shooting target. The confirmation area is selected as some areas that meet the criteria defined in the reference setting step S100 of the entire image. For example, in the face recognition mode, the face area recognized as the face of the person in the entire image becomes the confirmation area, and in the focus area mode, the focus area where the focus is adjusted in the entire image becomes the confirmation area. Can be.

FIG. 6 is a conceptual diagram illustrating a concept of extracting a partial image during the photographing operation of FIG. 5, and is an example when the face recognition mode is set in the reference setting step S100.

Since the face recognition mode is set, in the confirmation region selection step (S140), regions in which the face of the person is recognized in the entire image 95 are selected as the confirmation regions 95a and 95b. When the selection of the confirmation areas 95a and 95b is completed (S140), the step S150 of extracting the partial images 96 and 97 from the selected confirmation areas 95a and 95b is performed.

FIG. 7 is a conceptual diagram illustrating a concept of generating a live view image using the partial images of FIG. 6.

After the partial images 96 and 97 have been extracted (S150), the step S160 of synthesizing the live view image 98 by synthesizing the partial images 96 and 97 and the entire image 95 is performed. When the live view image 98 is generated, a display step S165 of displaying the live view image on the display unit is performed.

According to the photographing apparatus having the above-described configuration and the method of displaying a photographing target including the above-described steps, the detailed state and the region of the face of the person, i.e., the face of the person, are displayed. The overall composition of the screen (visible from the full image) is displayed in a composite on the Live View screen. Therefore, the user can conveniently check the details of various elements that he intended through the live view screen.

When the live view image is displayed on the display unit, it is checked whether the shutter is completely pressed (operation S2) (S170). If the execution of the operation S2 is not performed, the user returns to step S110 because the user has not performed the shooting. Perform the imaging step for live view again. When the execution of S2 is performed, since the user has performed the shooting, the image data obtained after the shooting is performed (S180) is stored (S190). The imaging operation of the imaging device performed in the imaging step S180 may correspond to an imaging operation having a higher resolution than that of the imaging operation performed in the live view imaging step S110.

8 is an operational state diagram illustrating an example of selecting a confirmation region to recognize an operation of an object by using the photographing apparatus of FIG. 1, and FIG. 9 is a conceptual diagram illustrating a concept of generating a live view image by the example of FIG. 8.

In the entire image 195 of the first live view screen displayed on the display unit of the photographing apparatus as shown in FIG. 8, when the user selects a partial region by dragging and touching the touch pen 190, the selected region is the confirmation region 195a. ) Is selected. 8 and 9 are selected to execute the function of the motion recognition in the user area mode, the photographing apparatus recognizes the motion of the subject 192 to track the movement of the subject 192 to confirm the confirmation area 195a. ) Position can be changed.

As shown in FIG. 8, when selection of the confirmation region 195a is completed, the partial image 196 is extracted as shown in FIG. 9, and then the partial image 196 and the entire image 195 are synthesized to display the live view image 198. ), The generated live view image 198 may be displayed on the display unit.

According to the photographing target display method as described above, the subject area of interest to the user is selected as the confirmation area and is enlarged and displayed in the live view image. In addition, since the confirmation area is changed and displayed according to the movement of the subject, the user may determine shooting while not missing the enlarged image of the moving subject.

Although the present invention has been described with reference to the above-described embodiments, these are merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the appended claims.

1 is a block diagram schematically illustrating a relationship between components of a photographing apparatus according to an exemplary embodiment of the present invention.

FIG. 2 is an operating state diagram illustrating an operation of setting a criterion for selecting a confirmation region using the photographing apparatus of FIG. 1.

3 is a block diagram schematically illustrating components of a live view generating unit of the photographing apparatus of FIG. 1.

4 is a flowchart illustrating steps of a photographing target display method according to an exemplary embodiment of the present invention.

5 is an operational state diagram illustrating a photographing operation using the photographing apparatus of FIG. 1.

FIG. 6 is a conceptual diagram illustrating a concept of extracting a partial image during the photographing operation of FIG. 5.

FIG. 7 is a conceptual diagram illustrating a concept of generating a live view image using the partial images of FIG. 6.

FIG. 8 is an operating state diagram illustrating an example of selecting a confirmation region to recognize an operation of an object by using the photographing apparatus of FIG. 1.

FIG. 9 is a conceptual diagram illustrating a concept of generating a live view image according to the example of FIG. 8.

DESCRIPTION OF THE REFERENCE NUMERALS

1: recording device 52: input unit

3: imaging unit 60: database

5: Shutter button 70: Live view generator

10: optical system 71: confirmation area setting unit

11: zoom drive unit 72: partial image extraction unit

12: lenses 73: image synthesizing unit

15: memory 98, 198: live view image

20: imaging device 120: confirmation area reference setting menu

40: control unit 121: face recognition menu

41: image conversion unit 122: focus area menu

42: driving circuit unit 123: user area menu

43: memory controller 130: change mode menu

44: touch screen controller 131: area freeze menu

45: reference setting unit 132: motion recognition menu

46: motion detection unit 190: touch pen

47: shooting control part 96, 97, 196: partial image

48: Focus adjuster 192, 91b: Subject

49: face detection unit 91, 95, 195: entire image

50: touch screen 91a, 95a, 95b, 195a: confirmation area

51: display unit

Claims (10)

An imaging unit which picks up a photographing target at predetermined intervals and generates image data representing an image; A reference setting unit that sets a criterion for selecting areas to be checked for shooting in the shooting target; In the image represented by the image data, a partial image is extracted from a confirmation region that satisfies the criterion set in the reference setting unit, and a live view image is obtained by combining the partial image and the entire image including the entire image represented by the image data. Live view generation unit for generating a; And And a display unit for outputting the live view image. The method of claim 1, The photographing apparatus further includes a person detecting unit detecting a person in the image data, and the reference setting unit includes a face area of the person detected by the person detecting unit in the area to be checked. The method of claim 1, The photographing apparatus further includes a focus adjusting unit that automatically adjusts focus by setting a focus area in the image of the image data, and the reference setting unit includes a focus area determined by the focus adjusting unit in the area to be checked. . The method of claim 1, The photographing apparatus further includes a user input unit configured to receive a user input, and the reference setting unit includes a user designation region designated by the user input unit in the region to be checked. The method of claim 4, wherein The photographing apparatus further includes a motion detecting unit detecting a movement of a subject existing in the user designated area, and the reference setting unit includes a region in which the subject exists in the region to be checked. A reference setting step of setting a reference for selecting areas to be checked for photographing; An imaging step of imaging an object to be photographed to generate image data representing an image; In the image represented by the image data, a partial image is extracted from a confirmation region that satisfies the criterion set in the reference setting step, and a live view image is obtained by combining the partial image and the entire image including the entire image represented by the image data. Generating a live view; And And a display step of outputting the live view image. The method of claim 6, The photographing target display method may further include a person detecting step of detecting a person in the image data, and the reference setting step includes a face area of the person detected by the person detecting step in the area to be checked. How to display. The method of claim 6, The photographing target display method further includes a focus adjusting step of automatically adjusting focus by setting a focus area in the image of the image data, wherein the reference setting step includes an area to check the focus area determined by the focus adjusting step. Included, shooting target display method. The method of claim 6, The photographing target display method further includes a user input step of receiving a user input, and the reference setting step includes a user designation area designated by the user input step in the confirmation area. 10. The method of claim 9, The photographing target display method may further include a motion sensing step of detecting a movement of a subject existing in the user designated area, and the reference setting step includes a region where the subject exists in the region to be checked. Way.

Images