KR20100130670A - Apparatus and method for obtaining image using face detection in portable terminal - Google Patents

Abstract

PURPOSE: An image acquiring method using the face detection in a portable terminal and a device are provided to acquire the desired image with one choice by guiding various shot types capable of photographing or editing. CONSTITUTION: A portable terminal gets coordinate information of a face from image through face detection(403). The portable terminal calculates the rate of a face in the image through the coordinate information(405). The portable terminal decides the kind of shot according to the rate of the face in the image(407, 409). If a user selects the kind of the image, the portable terminal acquires the image including the area which the portable terminal is corresponded(411, 413).

Description

Method and device for image acquisition using face detection in portable terminal {APPARATUS AND METHOD FOR OBTAINING IMAGE USING FACE DETECTION IN PORTABLE TERMINAL}

The present invention relates to an image acquisition method and apparatus using face detection in a portable terminal, and more particularly, to a method and apparatus for acquiring an image having a desired size through face detection.

In recent years, as the portable terminal becomes smaller and thinner, the convenience of portable is increased, and the demand for the portable terminal is gradually increasing. Accordingly, the additional functions mounted on the portable terminal are also diversifying. For example, the portable terminal provides various additional functions such as a game, a scheduler, a morning call, an MP3 (MPEG layer 3), a video player, and a digital camera. .

In particular, the digital camera function among the additional functions is a trend that is provided in most portable terminals as it is recently recognized as an essential component to users. The digital camera function provided in the portable terminal provides a function of taking a picture by recognizing a face from an image input from a sensor, in addition to a simple picture taking function. For example, recently, the face recognition function provides a function called a smile shot that detects a smiley face of a user and takes a picture. The smile shot recognizes a face from an image signal input from a sensor during a preview, detects a facial muscle change and exposure of a tooth, detects a smiling moment, and automatically takes a picture when the smiling moment is detected. Use

However, the smile shot simply detects only the smile moment of the face and automatically photographs the picture. Therefore, the smile shot may be photographed up to a portion not desired by the user or may be photographed with an undesired composition. That is, the smile shot captures a photograph by simply capturing a smile, regardless of the position of the person who is the subject, as shown in FIGS. 1A to 1C, even if the subject is biased to one side of the image. There is a problem to shoot.

The present invention has been made to solve the above problems, and an object of the present invention is to provide a method and apparatus for image acquisition using face detection in a portable terminal.

Another object of the present invention is to provide a method and apparatus for acquiring an image having a desired size through face detection in a portable terminal.

Another object of the present invention is to provide a method and an apparatus for capturing a picture using coordinate and size information of a face and size information of an image in a portable terminal.

It is still another object of the present invention to provide a method and apparatus for providing various types of shots according to coordinates and size information of a face and size information of an image in a portable terminal.

Another object of the present invention is to provide a method and apparatus for editing a corresponding image using coordinate and size information of a face and size information of an image in a portable terminal.

According to a first aspect of the present invention for achieving the above object, the image acquisition method using face detection in a portable terminal, the process of acquiring the coordinate information of the face in the image through the face detection, by using the coordinate information Calculating a proportion of the face in the image, determining a shot type according to the ratio, and acquiring an image including an area corresponding to the shot type selected by the user. .

According to a second aspect of the present invention for achieving the above objects, the image acquisition apparatus using face detection in a portable terminal, obtains the coordinate information of the face in the image through the face detection, and using the coordinate information And after calculating the ratio occupied by the face, determining a shot type according to the ratio, and obtaining a image including an area corresponding to the shot type selected by the user.

The present invention allows the user to acquire a desired image with a single selection by guiding the user with various types of shots that can be taken or edited based on the coordinate and size information of the face existing in the image and the size information of the image. In addition, an automatic capture function such as a smile shot can help to correctly acquire an incorrectly acquired image.

Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings. In describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

Hereinafter, a method and apparatus for acquiring an image by providing various types of shots that can be photographed or edited to a user based on coordinate information of a face and size information of a face existing in the image in the portable terminal will be described.

2 shows a block configuration of a portable terminal according to the present invention.

Referring to FIG. 2, the portable terminal includes a control unit 200, a camera unit 210, an image processing unit 220, a display unit 230, an input unit 240, and a storage unit 250. The controller 200 includes a shot manager 202.

The control unit 200 performs processing and control for voice call and data communication, and includes the shot managing unit 202 according to the present invention, so that the image frame or the storage unit 250 is input from the image processing unit 200. After recognizing the face in the image stored in the), and controls and processes a function for shooting or editing images of various sizes based on the recognized face.

That is, after the shot manager 202 acquires coordinate information of a face from the corresponding image, the shot manager 202 determines a shot type that can be taken or edited based on the acquired coordinate information of the face and size information of the corresponding image, and the user The controller controls and processes a function for acquiring an image corresponding to a specific shot according to the user setting. Here, the shot manager 202 may determine the type of shot that can be taken or edited by calculating a ratio of the face in the corresponding image. As shown in FIG. 5, the shot type represents various types of images formed around the face of the person in the entire image. The shot type includes an ECU (Extreme Close UP Shot) including only a face, and a head. CU (Close UP Shot) including face and face only, CS (Close Shot) from head to shoulder, Bust Shot (BS) from head to chest, WS (Waist Shot) from head to waist, Head to There are KS (Knee Shot) including the knee, and FS (Full Shot) including the whole body from head to toe. Here, which part of each person the shot includes may be changed according to a setting, and the type of the shot may also be changed.

The camera unit 210 includes a camera sensor for converting an optical signal detected at the time of image capturing into an electrical signal, and a signal processor for converting an analog image signal photographed from the camera sensor into digital data. The camera sensor may be a charge coupled device (CCD) sensor, and the signal processor may be a digital signal processor (DSP).

The image processor 220 processes the image signal output from the camera unit 210 in units of frames and outputs the image signal in accordance with the characteristics and size of the display unit 230. In addition, the image processor 220 includes an image codec, and the image codec functions to code an image signal in a set manner or to decode coded frame image data into original frame image data.

The display unit 230 displays state information, limited numbers and letters generated during the operation of the portable terminal. In addition, the display unit 230 displays the types of shots that can be taken or edited under the control of the controller 200, and displays a portion included in each shot in the currently displayed image.

The input unit 240 is provided with a plurality of function keys to provide the control unit 200 with key input data corresponding to a key pressed by the user. In particular, the input unit 240 receives a shot type for shooting or editing from the user according to the present invention.

The storage unit 250 stores various programs and data for controlling the overall operation of the portable terminal. In particular, the storage unit 250 may store a mapping table indicating the types of shots that can be taken or edited according to the ratio of faces in the image, and the types of shots that can be shot or edited using the face coordinate information and the image size information. You can also store a calculation that determines. For example, the storage unit 250 may store a mapping table as shown in Table 1 below.

Ratio (image height / face height) Types of shots you can shoot or edit Ratio <1 ECU only shot 1 ≤ ratio <2 ECU, CU 2 ≤ ratio <3 ECU, CU, CS 3 ≤ ratio <4 ECU, CU, CS, BS 4 ≤ ratio <6 ECU, CU, CS, BS, WS 6 ≤ ratio <8 ECU, CU, CS, BS, WS, KS 8 ≤ ratio ECU, CU, CS, BS, WS, KS, FS

Table 1 shows the types of shots that can be taken or edited according to the ratio of the image height and the face height.

3 illustrates a procedure of capturing an image in a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 3, when an image signal is input from the camera in step 301, the terminal recognizes a face from the input image signal and acquires coordinate information of the face. For example, when the terminal inputs an image as shown in FIG. 6 (a) and detects a face from the image by performing face detection as shown in FIG. 6 (b), As illustrated in FIG. 6C, coordinate information of the detected face region is obtained. Here, the coordinate information may be represented in the form of (x, y, width, height). In this case, x and y are XY coordinates as reference points for indicating coordinate information of the face, width is the length of the horizontal axis of the face, height is the length of the vertical axis of the face.

In step 305, the terminal calculates a ratio of the face to the entire image using the acquired coordinate information of the face. That is, the terminal calculates the size of the face using the coordinate information of the face, and then calculates a ratio of the face in the image using the face size and the size of the entire image.

In step 307, the terminal determines the types of shots that can be taken according to the calculated ratio. In this case, when determining the shot type, the terminal may use a mapping table indicating a shot type that can be taken according to the ratio, or use a calculation formula that determines the shot type that can be taken according to the ratio. In addition, when determining the shot type, the terminal may use a calculation formula for determining a shot type that can be photographed using face coordinate information and image size information instead of the obtained ratio.

In step 309, the terminal activates only the determined shot type among shot types provided by the terminal. For example, when the type of shot that can be photographed by the terminal is determined as ECU, CU, CS, VS, and WS, the ECU, CU, CS, VS, and WS can be selected by the user as shown in FIG. In addition, the non-capable shot types KS and FS are disabled so that the user cannot select them. Here, the terminal may display a line indicating an area corresponding to each of the activated shot types on the screen. In this case, the terminal may display the lines for all the activated shots on the screen, and may display only the lines corresponding to the shots in focus according to the user's key manipulation. In addition, the terminal may display the lines for all the activated shots on the screen, and change the thickness, color, shape, etc. of the lines corresponding to the focused shot.

In step 311, the terminal determines whether a shot type to be photographed by the user is selected from among the activated photographable shot types. For example, as illustrated in FIG. 6E, the terminal checks whether a CS shot is selected from among shotable shots. In this case, when the type of shot to be photographed is not selected, the terminal returns to step 303 to perform the following steps again. This is to reflect that the image signal input from the camera may be changed by the user's movement.

When the type of shot to be photographed is selected, the terminal proceeds to step 313 to check whether the smile shot function is set. If the smile shot is not set, the terminal proceeds directly to step 317 to capture an image input from the camera to acquire and store an image having a size corresponding to the selected shot type. In this case, after capturing the entire image as described above, the terminal may acquire an image having a size corresponding to the selected shot type, or may capture only an area corresponding to the selected shot type. For example, when the CS including the head to the shoulder of the person is selected as shown in FIG. 6 (e), the terminal may capture an image including only the area corresponding to the CS as shown in FIG. 6 (h). Can be.

 On the other hand, when the smile shot is set, the terminal proceeds to step 315 and detects a smile by recognizing a muscle change of a face and exposure of a tooth, and when the smile is detected, proceeds to step 317 to detect the smile. In this state, the image input from the camera is captured to acquire and store an image having a size corresponding to the selected shot type. Here, the smile detection uses a conventional technique. For example, when the type of shot to be photographed is selected as shown in FIG. 6 (e), the terminal senses smile of the photographing target as shown in FIG. 6 (f), and at the moment when the smile is detected, FIG. After capturing an image as shown in FIG. 6, only an area corresponding to the selected shot type is taken from the captured image, thereby obtaining an image as shown in FIG. 6 (h).

Thereafter, the terminal terminates the algorithm according to the present invention.

4 illustrates a procedure of editing an image in a portable terminal according to an embodiment of the present invention.

Referring to FIG. 4, when the image editing function is performed in step 401, the terminal proceeds to step 403 to recognize a face in the selected image to obtain face coordinate information. For example, when an image as shown in FIG. 6 (a) is selected, the terminal detects a face from the image by performing face detection as shown in FIG. 6 (b). As shown in FIG. 6 (c), coordinate information of the detected face region is obtained. Here, the coordinate information may be represented in the form of (x, y, width, height). In this case, x and y are XY coordinates as reference points for indicating coordinate information of the face, width is the length of the horizontal axis of the face, height is the length of the vertical axis of the face.

In step 405, the terminal calculates the ratio of the face to the entire image using the acquired coordinate information of the face. That is, the terminal calculates the size of the face using the coordinate information of the face, and then calculates a ratio of the face in the image using the face size and the size of the entire image.

In step 407, the terminal determines the editable shot type according to the calculated ratio. In this case, when determining the shot type, the terminal may use a mapping table indicating the editable shot type according to the ratio, or use a calculation formula for determining the editable shot type according to the ratio. The terminal may use a calculation formula for determining an editable shot type by using face coordinate information and image size information instead of the obtained ratio when determining the shot type.

In step 409, the terminal activates only the determined shot type among the shot types provided by the terminal. For example, when the editable shot type is determined to be ECU, CU, CS, VS, and WS, the terminal may select the ECU, CU, CS, VS, and WS as shown in FIG. 6 (d). The non-editable shot types KS and FS are disabled so that the user cannot select them. Here, the terminal may display a line indicating an area corresponding to each of the activated shot types on the screen. In this case, the terminal may display the lines for all the activated shots on the screen, and may display only the lines corresponding to the shots in focus according to the user's key manipulation. In addition, the terminal may display the lines for all the activated shots on the screen, and change the thickness, color, shape, etc. of the lines corresponding to the focused shot.

In step 411, the terminal checks whether a shot type to be edited by the user is selected from the activated editable shot types. For example, as illustrated in FIG. 6E, the terminal checks whether a CS shot is selected from editable shots.

 When the type of shot to be edited is selected, the terminal proceeds to step 413 to acquire and store an image having a size corresponding to the selected shot type in the image. In this case, the terminal may crop an area corresponding to the selected shot type in the image to acquire an image having a size corresponding to the selected shot type. For example, when the CS including the head to the shoulder of the person is selected as shown in FIG. 6 (e), the terminal crops only an area corresponding to the CS to acquire an image as shown in FIG. 6 (h). can do.

Thereafter, the terminal terminates the algorithm according to the present invention.

3 and 4, when the acquired image is smaller than the screen size of the terminal, the size of the obtained image is adjusted to match the screen size of the terminal or the rotated image is rotated. Can be.

Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the scope of the following claims, but also by the equivalents of the claims.

1 is a view showing an image obtained from a portable terminal according to the prior art;

2 is a block diagram of a portable terminal according to the present invention;

3 is a diagram illustrating a procedure of photographing an image in a portable terminal according to an embodiment of the present invention;

4 is a diagram illustrating a procedure of editing an image in a portable terminal according to an embodiment of the present invention;

5 is a view showing a type of shot in a portable terminal according to an embodiment of the present invention, and

6 is a diagram illustrating a screen configuration for acquiring an image in a portable terminal according to an embodiment of the present invention.

Claims (14)

In the image acquisition method using face detection in a portable terminal, Acquiring the coordinate information of the face in the image through face detection; Calculating a proportion of the face in the image by using the coordinate information; Determining a shot type according to the ratio; And acquiring an image including an area corresponding to the type of shot selected by the user. The method of claim 1, The coordinate information may include at least one of XY coordinate information, a height of a face, and an area of the face. The method of claim 1, The shot type may include an extreme close up shot (ECU) including only a face, a close up shot (CU) including only a head and a face, a close shot (CS) including a head to a shoulder, and a BS including a head to a chest ( Bust Shot), WS (Waist Shot) from head to waist, KS (Knee Shot) from head to knee, and FS (Full Shot) from head to toe . The method of claim 1, The shot type is determined using a mapping table indicating a shot type usable according to the ratio, or using a calculation formula for determining the shot type usable according to the ratio. The method of claim 1, And displaying a line representing an area corresponding to the selected shot type. The method of claim 1, Acquiring an image including an area corresponding to the selected shot type may include: Cropping an area corresponding to the selected shot type in an entire image; And resizing or rotating the cropped image according to the size of the screen. The method of claim 1, Acquiring an image including an area corresponding to the selected shot type may include: Receiving a shot type from the user; Performing a smile shot detection function to detect smiles of people to be photographed; Capturing an image input from a camera at the moment when the smile is detected; Cropping an area corresponding to the selected shot type in the captured image. An image acquisition apparatus using face detection in a portable terminal, Acquire face coordinate information from the image through face detection, calculate the ratio of the face to the image using the coordinate information, determine the shot type according to the ratio, and correspond to the shot type selected by the user. And a control unit for acquiring an image including an area of the image. The method of claim 8, The coordinate information may include at least one of XY coordinate information, a height of a face, and an area of the face. The method of claim 8, The shot type may include an extreme close up shot (ECU) including only a face, a close up shot (CU) including only a head and a face, a close shot (CS) including a head to a shoulder, and a BS including a head to a chest ( Bust Shot), WS (Waist Shot) including head to waist, KS (Knee Shot) including head to knee and FS (Full Shot) including head to toe . The method of claim 8, The control unit, when calculating the shot type, using a mapping table indicating the available shot type according to the ratio or using a calculation formula for determining the available shot type according to the ratio. The method of claim 8, And a display unit for displaying a line representing an area corresponding to the selected shot type. The method of claim 8, The controller may crop an area corresponding to the selected shot type in the entire image, and resize or rotate the cropped image to fit the screen size. The method of claim 8, A camera unit for receiving an image signal, An image processor which processes the image signal in image frame units and provides the image signal to the controller; When the shot type is selected by the user, the controller performs a smile shot detection function to detect a smile of a person to be photographed, captures an image frame input from the camera at the moment when the smile is detected, and captures the smile. And cropping an area corresponding to the selected shot type in the captured image.

Images