KR100872349B1 - Portable terminal and method for frame inserting thereof - Google Patents

Abstract

The present invention relates to a mobile terminal and a method of inserting a frame thereof, the method comprising: determining a region of a photo into which a frame is to be inserted in a frame insertion mode; adjusting the determined photo region to a size of a frame; The process of storing. According to the present invention, frame insertion can be easily performed in a picture having a different standard from a normal picture, such as a panorama. In particular, since a face may be detected in a picture or a specific point may be selected and a frame may be inserted in the area, user convenience may be improved.

Frame, insertion, panorama, face, point

Description

PORTABLE TERMINAL AND METHOD FOR FRAME INSERTING THEREOF}

1 is a schematic block diagram of a portable terminal for frame insertion according to the present invention;

2 is a flowchart schematically illustrating an operation of a portable terminal for frame insertion according to a first embodiment of the present invention.

3A is a flowchart schematically illustrating an operation of a mobile terminal in the frame insertion mode of FIG. 2.

3B is a flowchart schematically illustrating an operation of a mobile terminal for inserting a frame into the detected face image of FIG. 2.

4A to 4D are diagrams schematically illustrating a frame insertion operation screen of a mobile terminal according to the first embodiment of the present invention.

5A is a flowchart schematically illustrating an operation of a portable terminal for frame insertion according to a second embodiment of the present invention;

FIG. 5B is a flowchart schematically illustrating an operation of a mobile terminal for inserting a frame into an area including a specific point of FIG. 5A.

6A to 6C are schematic views illustrating a frame insertion operation screen of a mobile terminal according to a second embodiment of the present invention.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal and a method for processing a photo thereof, and more particularly, to a portable terminal and a frame insertion method for easily inserting a frame of a photo having a larger standard than a general photo.

A panorama (panorama) is a way of taking longer shots in the lateral or up-and-down direction than usual to capture more landscape in a picture. The principle of panoramic photography is to stitch several pictures taken side by side or long ones up and down.

On the other hand, the photo editing function of the portable terminal has a frame editing function for editing a photo using a background stored in the portable terminal. The frame editing function edits by using the margin part of the stored frame, and has an advantage of removing unnecessary background surroundings and emphasizing only necessary parts in the captured or stored picture. In particular, the frame editing function is mainly used for portrait photography.

However, the frames used in such a frame editing function have a form and size that are easy for editing a general picture. For this reason, when frame editing is performed on a panoramic picture, when the panoramic picture is aligned with the frame, the panoramic picture is distorted, and when the frame is aligned with the panoramic picture, the frame is stretched. Therefore, since the ratio of the width to the height of the panoramic picture is different from that of the general picture, the user may experience inconvenience when performing the frame editing function.

Accordingly, an object of the present invention is to provide a mobile terminal and a frame insertion method thereof, which inserts a frame into a specific area of a picture and adjusts and stores the area to a size of the frame when the frame is inserted.

Another object of the present invention is to provide a mobile terminal and a frame insertion method thereof for inserting a frame on a detected face image when the frame is inserted.

Another object of the present invention is to provide a mobile terminal and a frame insertion method thereof for inserting a frame on a selected specific point when the frame is inserted.

In accordance with another aspect of the present invention, there is provided a frame insertion method of a mobile terminal, the method including: determining a region of a photo into which the frame is to be inserted in a frame insertion mode; and adjusting the determined photo region to the size of the frame; And storing the area of the picture in which the frame is inserted.

Another object of the present invention is to provide a portable terminal, comprising: a memory unit for storing pictures and frames, and an area of the picture to be inserted into the frame in frame insertion mode to adjust the size of the picture area; And a control unit for storing.

DETAILED DESCRIPTION A detailed description of preferred embodiments of the present invention will now be described with reference to the accompanying drawings. In the embodiment of the present invention, the term "frame" is a frame such as a frame, a mirror, a window, or the like, as defined in the dictionary, and is used as a background such as a frame when capturing images using a camera. .

The term "general photo" means a photo of a standard photographed on a general mobile terminal. In addition, the term "photograph" means a photograph having a different specification from a general photograph. That is, the picture refers to a picture that is different in width or length or in aspect ratio from the normal picture. For example, the picture is a panoramic picture. In the following description, a photograph is a panoramic photograph, but is not limited thereto.

First embodiment

1 is a block diagram schematically illustrating a portable terminal for frame insertion according to the present invention.

Referring to FIG. 1, a portable terminal according to the present invention includes a general configuration of a key input unit 101, a camera 103, an image processing unit 105, a display unit 107, a memory unit 109, and a control unit 111. Have

The key input unit 101 receives a user's operation signal for controlling the operation of the portable terminal. The key input unit 101 performs operations such as selecting a frame inserting mode of the panoramic picture, selecting a panoramic picture and a face detected in the panoramic picture, and taking a panoramic picture according to the present embodiment.

The camera 103 photographs an image signal. The camera 103 includes a camera sensor that converts the photographed optical signal into an electrical signal, and a signal processor that converts the analog image signal photographed from the camera sensor into a digital signal.

In addition, the camera 103 can take a panoramic picture according to the present embodiment. Here, the panoramic photographing is performed by continuously taking photographs while shifting the photographing direction, for example, and accurately fitting seams of two adjacent photographs. To this end, the next picture is taken so as to overlap a part of the previously taken picture, and the user takes the next picture while looking at a part of the first picture. Then, the camera 103 takes a panoramic picture with a face. That is, take a portrait picture.

The image processor 105 performs a function of generating screen data for displaying an image signal output from the camera 103. The image processing unit 105 includes an image codec and performs a function of compressing image data displayed on the display unit 107 in a set manner or restoring the compressed image data to original image data.

The display unit 107 visually displays various information related to the state and operation of the portable terminal. The display unit 107 displays a panoramic picture taken by the camera 103 or stored in the memory unit 109 according to the present embodiment.

In addition, the display unit 107 displays a form in which the frame is inserted in the area where the face is detected in the panoramic picture. In addition, when there are a plurality of faces detected in the panoramic picture, the display unit 107 displays a form in which a frame is inserted into another face area. In addition, the display unit 107 displays only the face area of the panoramic picture in which the frame is inserted.

The memory unit 109 stores programs and information necessary for the operation of the portable terminal. The memory unit 109 stores a program and a frame for inserting a frame of the panoramic picture according to the present embodiment. The memory unit 109 stores the panorama picture. Here, the panorama picture stored in the memory unit 109 may be taken by the camera 103, or may be provided from the outside. In addition, the memory unit 109 stores a form in which a frame is inserted into a specific region of the panoramic picture.

The controller 111 controls the overall operation of each component of the mobile terminal. The controller 111 detects the face of the panoramic picture in the frame insertion mode according to the present embodiment.

Here, the method for detecting a face is a paper published in December 1996 by Ji Eun-mi, “Face Recognition Using Edge Information,” in 論 文集: 22, p287 ~ 297. Face Recognition Technique Using Fuzzy Neural Network ”published in February 2003 in“ Hanyang University Graduate School Proceedings ”,“ Face Recognition Method and Apparatus ”of Korean Patent Publication No. 10-0608595, Korean Patent Publication No. 10-0602576 "Face Recognition Method and Person Search / Display Method Using It", Korean Patent Application Publication No. 10-2006-0035198, "Automatic Camera Zooming System Using Face Recognition Technique, Mobile Communication Terminal Equipped with It and Camera Using Face Recognition Technique" Automatic zoom method ”and the like, any of the known techniques can be used.

When the face detection method is described using, for example, "Face Recognition Method and Apparatus" of Korean Patent Publication No. 10-0608595, first, a recognition target image is input, and the input recognition image is converted into a digital pixel value. Then, the face localizer extracts a face region from the converted digital pixel value, and extracts a predetermined number of feature points to apply a Gabor filter from the face region. Next, the Gabor filter unit obtains response values by applying a set of Gabor filters having a plurality of directionalities and frequencies to each of the extracted feature points, and expresses the response values as one-dimensional vectors or arrays. Thus, a Gabor filtered vector is obtained. The obtained Gabor filtered vector is then provided to the discriminator of the binary classifier. The discriminator of the binary classifier identifies the face by applying the Gabor filtered vector provided from the Gabor filter unit to the binary discrimination criteria provided from the learning unit.

In addition, the controller 111 adjusts a specific region of the panoramic picture according to the size of the frame. The controller 111 enlarges the face area of the panoramic picture to fit the size of the frame, or cuts the picture area to include the face area of the panoramic picture.

In addition, when there are a plurality of faces detected in the panoramic picture, the controller 111 proceeds to insert frames in the order of detection. The controller 111 may insert and store a frame in a specific area of the panoramic picture, and then select another panoramic picture to proceed with frame insertion. In addition, the control unit 111 proceeds to the frame insertion mode of the panorama picture after the photographing of the panorama picture through the camera 103 or by selecting the panorama picture in the frame insertion mode.

Meanwhile, the aforementioned portable terminal may further include an RF unit for performing a wireless communication function. Here, the RF unit includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, an RF receiver for low noise amplifying and downconverting a received signal, and the like.

Hereinafter, a frame insertion method of a mobile terminal according to the present invention will be described. 2 is a flowchart schematically illustrating an operation of a portable terminal for inserting a frame according to a first embodiment of the present invention. 3A is a flowchart schematically illustrating an operation of the portable terminal in the frame insertion mode of FIG. 2, and FIG. 3B is a flowchart schematically illustrating an operation of the portable terminal inserting a frame into the detected face image of FIG. 2. 4A to 4D are diagrams schematically illustrating a frame insertion operation screen of the mobile terminal according to the first embodiment of the present invention.

Referring to FIGS. 1 and 2, 3A and 3B, and FIGS. 4A to 4D, a method of inserting a frame of a mobile terminal according to the present invention will be described. First, as shown in FIG. The frame editing mode of the panoramic picture is executed (S201). This process will be described in detail with reference to FIG. 3A.

Referring to FIG. 3A, first, the control unit 111 checks whether a panorama photographing mode is requested from a user (S301). In the panorama photo capture mode, the controller 111 captures the panorama photo using the camera 103 (S303). A screen in which a panoramic picture is taken using the camera 103 is illustrated in FIG. 4A. In FIG. 4A, a panoramic photograph is shown in which a horizontal length is longer than a vertical length. 4A shows the entire panoramic picture. As described above, the photograph is not limited to the panoramic photograph, and any photograph is a photograph having a larger standard than the general photograph.

Next, the controller 111 checks whether the frame insertion mode is selected using the panorama picture photographed in step S303 (S305).

On the other hand, if it is not confirmed in the above-described step S301 request of the panorama picture shooting mode, the control unit 111 confirms the request of the frame insertion mode (S307). That is, the controller 111 confirms the selection of the frame insertion mode.

Subsequently, when the frame insertion mode is selected, the control unit 111 receives a desired picture from among panorama pictures stored in the memory unit 109 (S309). The panorama picture selected by the user is displayed on the display unit 107 as shown in FIG. 4A.

As described above, when the frame insertion mode is selected after the panorama picture is taken in steps S301 to S305, or when the panorama picture for frame insertion is selected in steps S307 and S309, the control unit 111 performs a panorama as shown in FIG. 2. The face is detected in the picture (S203). Here, the face detection in the photograph may be performed by the known technique as described above.

Next, the control unit 111 inserts a frame into the detected face (S205). This process will be described in detail with reference to FIG. 3B.

Referring to FIG. 3B, the control unit 111 detects a face in the picture and checks whether there are a plurality of faces detected in the panoramic picture (S331). One or more faces may be present in the taken or selected panorama picture.

When there are a plurality of detected faces, the controller 111 inserts a frame into the first face (S333). 4B illustrates a screen in which a frame is inserted into a face detected first in a panorama photograph in which a plurality of faces exist. As shown in FIG. 4B, when the frame inserting mode is selected in the panoramic photograph in which four people are photographed, the frame is inserted 401 in the first face.

Next, the controller 111 checks whether another face is selected by the user (S335). The user may wish to insert a frame into a face other than the first detected face. Here, the selection of the other face may be performed through manipulation of a key such as a direction key of the key input unit 101. In addition, the control unit 111 may move and insert the frames on the face in the order of detection by the manipulation of the key input unit 101. In FIG. 4B, the frame is inserted 403 into the face detected by the operation of the key input unit 101 together with the first face 401.

If the selection of the other face is not confirmed, the controller 111 adjusts the face region in which the frame is inserted in accordance with the frame size (S337). The process adjusts, for example, enlarges only the face area to be inserted into the frame, or crops the photo area to include the face area to be inserted into the frame. The shape of inserting the frame by enlarging and adjusting only the face area is illustrated in FIG. 4C, and the form of cutting the photo area and inserting the frame into the frame is illustrated in FIG. 4D. That is, FIG. 4C illustrates a form in which only the detected face is adjusted to the frame size. 4D illustrates a form in which a region of a photo including a detected face is adjusted to a frame size. This process can be selected by the user's settings.

Subsequently, the controller 111 checks whether or not the photo region in which the frame is inserted is stored in the form as illustrated in FIG. 4C or 4D (S339). When confirming the storage signal, the controller 111 stores the picture of the form as shown in FIG. 4C or 4D in the memory unit 109.

Next, the controller 111 checks whether another face is selected by the user for frame insertion (S341). The controller 111 may store a specific area of the picture in which the frame is inserted, and then select another face for inserting the frame in the panorama picture. Herein, when the selection of the other face is confirmed, the control unit 111 returns to the above-described step S333.

On the other hand, if no other face is selected in the above-described step S341, the controller 111 checks whether another picture for frame insertion is selected (S343). Upon selecting another picture, the control unit 111 returns to the above-described process S201.

If no other picture for frame insertion is selected, the controller 111 checks whether the frame insertion mode is terminated (S345), and terminates the present function.

On the other hand, if there are not a plurality of faces detected in the above-described step S331, that is, if there is only one detected face, the controller 111 inserts a frame into the detected face (S347). In addition, the control unit 111 checks whether the form displayed in step S347 is selected. When selected, the controller 111 adjusts the detected face area to fit the frame size in step S337 (S351).

Next, the control unit 111 checks whether or not to store (S353), and when the storage request is made, returns to the aforementioned S343 process.

On the other hand, if the form displayed by the above-described step S347 in step S349 is not selected, the control unit 111 returns to the above-described step S343.

The portable terminal and the frame insertion method thereof according to the present embodiment can easily insert a frame in a picture having a different standard from a normal picture, for example, a panorama. In particular, since a face may be detected in the picture and a frame may be inserted in the area, user convenience may be improved.

Second embodiment

In this embodiment, descriptions of the same components as those of the first embodiment or corresponding components will be omitted.

The portable terminal and the frame insertion method using the same according to the present embodiment are similar to the first embodiment described above, but have a feature of inserting a frame by selecting a specific point in a panoramic photograph of a landscape without a face.

Referring to FIG. 1, the key input unit 101 of the portable terminal according to the present invention performs an operation such as selecting a specific point in a panoramic picture for inserting a frame according to the present embodiment.

The camera 103 takes a landscape panoramic picture without a face, that is, a person.

The display unit 107 displays a form in which a frame is inserted at a specific point in the panoramic picture. In addition, the display unit 107 displays only an area including a specific point of the panoramic picture in which the frame is inserted.

The controller 111 inserts a frame at a specific point of the panorama picture selected in the frame insertion mode. The controller 111 performs the function as described above when selecting another point or another picture of the panoramic picture.

In addition, the controller 111 adjusts the photo area around a specific point to fit the frame size. Here, the controller 111 may proceed by enlarging a specific point according to the frame size or cutting the photo area around the specific point according to the frame size.

Hereinafter, a frame insertion method of a mobile terminal according to the present invention will be described. FIG. 5A is a flowchart schematically illustrating an operation of a mobile terminal for inserting a frame according to a second embodiment of the present invention, and FIG. 5B is a schematic view of an operation of the mobile terminal for inserting a frame in an area including a specific point of FIG. 5A. It is a flow chart shown. 6A to 6C schematically illustrate a frame insertion operation screen of a mobile terminal according to a second embodiment of the present invention.

Referring to FIGS. 1, 5A, 5B, and 6A to 6C, a method of inserting a frame of a mobile terminal according to the present invention will be described. First, as illustrated in FIG. 5A, the control unit 111 edits a frame of a panoramic picture. The mode is executed (S501). This process is described as the process described with reference to FIG. 3A in the above-described first embodiment.

As described above, when the frame insertion mode is selected after the panorama picture is taken in steps S301 to S305, or when the panorama picture for frame insertion is selected in steps S307 and S309, the controller 111 receives a specific point from the panorama picture ( S505). 6A illustrates a screen in which a specific point 601 of a panoramic picture is selected through a key input unit 101 from a user. As shown in FIG. 6A, the user selects a specific point 601 for inserting a frame in the panorama picture displayed on the display unit 107 through manipulation of the key input unit 101.

Subsequently, the controller 111 inserts the frame into the area including the selected specific point 601 (S505). This process will be described in detail with reference to FIG. 5B.

Referring to FIG. 5B, when a specific point is selected in the panorama picture, the controller 111 inserts a frame at the specific point (S531). A screen in which a frame is inserted at a specific point 601 selected by the user is shown in FIG. 6B. As shown in FIG. 6B, the control unit 111 inserts a frame into the photo area including the specific point 601 selected by the user.

Next, the control unit 111 checks whether or not the selection of the form displayed in step S531, and when selected, the control unit 111 adjusts the panorama picture area to the frame size around the specific point (S535). The controller 111 crops the panorama picture to fit the frame size around a specific point. 6C illustrates a form in which the panoramic picture is adjusted to the frame around the point selected by the user. Here, the controller 111 may enlarge a specific point to fit the frame size. If the selection is not confirmed, the control unit 111 proceeds to step S539.

Subsequently, the control unit 111 checks whether or not the picture area in which the frame is inserted is stored in the form as shown in FIG. 6C (S537). When confirming the storage signal, the controller 111 stores the picture of the form as shown in FIG. 6C in the memory unit 109.

Next, the control unit 111 confirms whether another point for frame insertion is selected by the user (S539). In this case, when checking the selection of another point, the control unit 111 returns to the above-described step S531.

On the other hand, if another point is not selected in the above-described step S539, the control unit 111 checks whether or not to select another picture for frame insertion (S541). Upon selecting another picture, the control unit 111 returns to the above-described process S501.

If no other picture for frame insertion is selected, the controller 111 checks whether the frame insertion mode is terminated (S543) and terminates this function.

On the other hand, the portable terminal according to the present invention and the frame insertion method using the same are not limited to the above-described embodiments and may be variously modified within the scope not departing from the technical spirit of the present invention. This will be readily apparent to those skilled in the art.

According to the present invention, the frame insertion can be easily performed in a picture different from a normal picture and a standard, for example, a picture such as a panorama. In particular, since a face may be detected in a picture or a specific point may be selected and a frame may be inserted in the area, user convenience may be improved.

Claims (17)

Selecting the frame insertion mode while displaying a photo, Detecting a face in the picture and inserting the frame into the detected face area, or selecting a specific point in the picture and inserting the frame in the picture area including the selected specific point; And adjusting the size of the picture so as to be inserted into the frame, and storing the area of the picture in which the frame is inserted. The method of claim 1, wherein the photograph, Frame insertion method of a mobile terminal, characterized in that the picture is larger than the standard picture stored or taken in the mobile terminal. The method of claim 2, wherein the photograph, Frame insertion method of a mobile terminal, characterized in that the panorama picture. The method of claim 1, wherein the adjusting the picture size, Enlarge the picture to be inserted into the frame, cut the face area in the picture to be inserted into the frame, or cut a picture area including the specific point in the picture to be inserted into the frame. Frame insertion method of a mobile terminal. delete The method of claim 1, wherein the inserting process is Inserting the frame into the first detected face when there are a plurality of detected faces when detecting a face in the photograph; And inserting the frame into the detected other face when the detected other face is selected. According to claim 1, Checking whether to select another picture for inserting the frame after the storing process; The frame insertion method of the mobile terminal, characterized in that further comprising the step of returning to the selection process when the other picture is selected. delete The method of claim 1, wherein the inserting process is And inserting the frame into the picture area including the selected other point when the other point is selected in the picture. delete A memory unit for storing pictures and frames, When the frame insertion mode is selected while displaying a picture, the frame is detected in the picture and the frame is inserted into the detected face area, or a specific point is selected in the picture to select the frame in the picture area including the selected specific point. And a controller configured to insert a, adjust the picture size, and store the picture area in which the frame is inserted into the memory unit. The method of claim 11, wherein the photograph, A portable terminal, characterized in that the picture is larger than the standard picture stored or taken by the portable terminal. The method of claim 12, wherein the photograph, A mobile terminal, characterized in that the panorama picture. The method of claim 11, wherein the control unit, When resizing the picture, the picture area includes the specific point in the picture to enlarge the picture to be inserted into the frame, to cut the face area in the picture to be inserted into the frame, or to be inserted into the frame. Mobile terminal, characterized in that for cutting. delete The method of claim 11, wherein the control unit, When detecting a face in the picture, if there is a plurality of detected faces, the mobile terminal characterized in that the selection of the other face for the frame insertion to insert the frame. delete

Images