KR20070006337A - Method for editing image in wireless terminal - Google Patents

Abstract

A method for editing an image in a portable terminal is provided to change and represent a facial expression in a photo, to extract the facial expression, to store the extracted facial expression, and to synthesize the facial expression such that various services can be offered. A method for editing an image in a portable terminal comprises the following several steps. A controller senses selection of a photo among stored plural photos and displays the selected photo(201). If a user selects a facial expression effect while the selected photo is displayed, the controller extracts a facial position in the selected photo(202,203). If the facial position is extracted, the controller extracts an eye and a mouth position from the extracted face(204). The controller senses the extraction of the eye and the mouth position, and displays the extracted eye and mouth position on the first-the third area(205). The controller senses selection for modifying the photo(206) and then modifying the first-the third area(300). The controller senses selection of a corresponding facial expression among the kinds of the plural facial expressions(207) and applies the selected facial expression to the facial expression of the photo(208). The controller senses comparison of the facial expression of the photo with the selected facial expression(209) and concurrently displays the original photo and the changed photo(210). The controller senses a grade control(211), and displays the facial expression of the photo according to each grade(212). The controller senses storage of the facial expression(213) and stores the photo where the facial expression is changed according to the selection of a user(214).

Description

Image editing method of mobile terminal {METHOD FOR EDITING IMAGE IN WIRELESS TERMINAL}

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

2 is a flowchart illustrating a process of changing face expression in a mobile terminal according to an embodiment of the present invention.

3 is a flowchart illustrating a region modification process in FIG. 2;

4A-4D are views for explaining FIG. 2;

5A to 5I are views illustrating a photo changed to a facial expression type selected through FIG. 2;

6 is a flowchart illustrating a process of extracting and storing facial expressions in a mobile terminal according to an embodiment of the present invention.

7 is a flowchart illustrating a process of generating and storing facial expressions in a mobile terminal according to an embodiment of the present invention.

8 is a flowchart illustrating a process of synthesizing facial expressions in a mobile terminal according to an embodiment of the present invention.

The present invention relates to an image editing method of a portable terminal, and more particularly, to an image editing method of a portable terminal capable of editing facial expression of a photograph.

Currently, portable mobile communication terminals are converting to a structure capable of transmitting high speed data in addition to voice communication functions. Data that can be processed by the mobile terminal performing the data communication may be packet data and image data.

Currently, the mobile terminal has a function of transmitting and receiving image data. Therefore, the video screen received from the base station is stored or the acquired video screen is transmitted to the base station. In addition, the portable terminal may include a camera for photographing an image screen and a display unit for displaying an image signal photographed by the camera. The camera may use a CCD or a CMOS sensor, and the display unit may use an LCD. In addition, with the miniaturization of the camera device, the device for capturing the image is becoming more and more miniaturized. The portable terminal may capture a video screen and display the moving picture and the still picture, and transmit the captured video screen to the base station.

As described above, as the needs of operators and consumers are increased with respect to video mails, the above-mentioned services are implemented, and the trend is to be greatly increased in the future. In addition, the functions of editing a video screen by a user's operation in the portable terminal are also increasing. For example, techniques for zooming in and zooming out a photo image stored in a mobile terminal or synthesizing a plurality of photo images are implemented.

In addition, although the performance of the camera provided in the portable terminal has been developed, there are cases where natural facial expression or emotional expression does not occur as desired when actually photographing. In such a case, there is a hassle to download the photographed picture to a computer and change it to a desired look through Photoshop work.

Accordingly, an object of the present invention is to provide an image editing method of a portable terminal which can display a changed face expression of a photo in the portable terminal.

Another object of the present invention is to provide an image editing method of a portable terminal capable of extracting and storing a facial expression of a photo from the portable terminal.

It is still another object of the present invention to provide an image editing method of a portable terminal capable of generating and storing a facial expression of a photo in the portable terminal.

Still another object of the present invention is to provide an image editing method of a mobile terminal capable of synthesizing a facial expression of a photo in the mobile terminal.

The image editing method in the mobile terminal for achieving the above object comprises the steps of: displaying the facial expression types, if the facial expression effect is selected while displaying a photo; And changing the face expression of the picture to a selected facial expression type among the facial expression types.

In addition, the image editing method in the mobile terminal to achieve the above object, if the facial expression effect is selected during the display of the display, the process of displaying the area for displaying the position of the eyes and mouth in the photo; Modifying the areas indicating the positions of the eyes and mouth when the correction for the areas is selected; When the type of the facial expression effect is selected, a process of changing and displaying the facial expression of the picture with the selected facial expression is performed.

In addition, the image editing method in the mobile terminal to achieve the above object, if the facial expression effect is selected while displaying a picture, displaying the first to third areas for specifying the position of the eyes and mouth in the picture; When the correction for the regions is selected, a corresponding region among the first to third regions is selected, a corresponding point among the points constituting the selected region is selected, and the selected point is moved to a corresponding position to move the selected region to the corresponding position. Modifying and displaying three regions; When the type of facial expression effect is selected, the first and third regions of the selected facial expression may be applied to the first and third regions of the photo to display the changed facial expression of the photo.

In addition, the image editing method in the mobile terminal, if the facial expression storage is selected while displaying a photo, the process of extracting the position of the eyes and mouth in the photo to display the areas; Modifying the areas indicating the positions of the eyes and mouth when the correction for the areas is selected; If storage for the facial expression of the photo is selected, characterized in that the process of storing the expression of the extracted photo.

In addition, the image editing method in the mobile terminal, if the making of the facial expression is selected in the mobile terminal, displaying a basic picture having areas indicating the position of the eyes and mouth; Generating a facial expression while changing a pixel value of a corresponding point in a corresponding area in the basic picture; Characterized in that the process of storing the generated facial expression.

In addition, the image editing method in the mobile terminal, if the face matching composition is selected, the step of extracting the position of the eyes and mouth from the selected first and second pictures, respectively; In an embodiment, the eye and mouth of the first photograph may be applied to the second photograph, or the photograph of eye and mouth of the second photograph may be applied to the first photograph.

DETAILED DESCRIPTION Hereinafter, detailed descriptions of preferred embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the same components in the figures represent the same numerals wherever possible.

1 is a diagram illustrating a configuration of a portable terminal according to an embodiment of the present invention, which illustrates a configuration of a portable terminal including a camera.

Referring to FIG. 1, the RF unit 123 performs a wireless communication function of the portable terminal. The RF unit 123 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal. The modem 120 includes a transmitter for encoding and modulating the transmitted signal, a receiver for demodulating and decoding the received signal, and the like. The audio processor 125 may configure a codec, and the codec includes a data codec for processing packet data and an audio codec for processing an audio signal such as voice. The audio processor 125 converts and reproduces the digital audio signal received by the modem 120 through the audio codec or converts the analog audio signal generated from the microphone into a digital audio signal through the audio codec and converts the digital audio signal into the digital audio signal. Sends the function to 120. The codec may be provided separately or included in the controller 110.

The memory 130 may include program memory and data memories. The program memory may store programs for controlling a general operation of the portable terminal and programs for changing, storing, and synthesizing facial expressions in a photo according to an embodiment of the present invention. The data memory also temporarily stores data generated during the execution of the programs.

The controller 110 controls the overall operation of the mobile terminal. In addition, the controller 10 may include the modem 120 and the codec. In addition, the controller 110 controls to change the face expression of the picture to the selected face expression according to an embodiment of the present invention. In addition, the control unit 110 controls to extract and store the facial expression of the picture according to an embodiment of the present invention. In addition, the controller 110 controls to generate and store facial expressions of a photo according to an embodiment of the present invention. In addition, the control unit 110 controls to extract a facial expression of a photo and to synthesize it into another photo according to an embodiment of the present invention.

The camera module 140 includes a camera sensor for capturing image data, converting the photographed optical signal into an electrical signal, and a signal processor for converting the analog image signal photographed from the camera sensor into digital data. Herein, it is assumed that the camera sensor is a CCD sensor, and the signal processor may be implemented by a digital signal processor (DSP). In addition, the camera sensor and the signal processor may be integrally implemented or may be separately implemented.

The image processor 150 performs a function of generating screen data for displaying an image signal output from the camera unit 140. The image processor 150 processes the image signal output from the camera unit 40 in units of frames, and outputs the frame image data according to the characteristics and size of the display unit 160. In addition, the image processor 50 includes an image codec and performs a function of compressing the frame image data displayed on the display unit 160 in a set manner or restoring the compressed frame image data to the original frame image data. The image codec may be a JPEG codec, an MPEG4 codec, a wavelet codec, or the like. It is assumed that the image processor 150 has an On Screen Display (OSD) function, and may output on-screen display data according to a screen size displayed by the control of the controller 110.

The display unit 160 displays the image signal output from the image processor 50 on the screen, and displays the user data output from the controller 110. The display unit 160 may use an LCD. In this case, the display unit 160 may include an LCD controller, a memory capable of storing image data, and an LCD display device. In this case, when the LCD is implemented using a touch screen method, the LCD may operate as an input unit. In addition, the display unit 160 may display the first to third areas for designating the positions of the eyes and the mouth during the facial expression editing process according to the exemplary embodiment of the present invention.

The key input unit 127 includes keys for inputting numeric and character information and function keys for setting various functions. In addition, the key input unit 127 may include keys for controlling the first to third areas for designating the positions of the eyes and the mouth during the facial expression editing process in the embodiment of the present invention.

An operation of editing facial expressions in the above-described mobile terminal will be described in detail with reference to FIGS. 2 to 7.

2 is a flowchart illustrating a process of changing face expression in a mobile terminal according to an embodiment of the present invention, FIG. 3 is a flowchart illustrating a region modification process in FIG. 2, and FIGS. 4A to 4D illustrate FIG. 2. It is for the drawing.

Hereinafter, an embodiment of the present invention will be described in detail with reference to FIG. 1.

Referring to FIG. 2, when a corresponding picture is selected from the pictures stored in the memory 130 of the portable terminal, the controller 110 detects it and proceeds to step 201 of displaying the selected picture on the display unit 160. (A)-(c) of FIG. 4a illustrate the process. When the corresponding picture is selected through (a) and (b) of FIG. 4a, the selected corresponding picture as shown in (c) of FIG. 4a. Is displayed.

If the facial expression effect is selected while displaying the corresponding picture selected as shown in FIG. 4A, the controller 110 proceeds to step 203 in which the face position is extracted from the picture as shown in FIG. 4A (D). do. When the face position is extracted in step 203, the controller 110 proceeds to step 204 to extract the positions of eyes and mouth from the extracted face as shown in (e) of FIG.

In step 204, when the positions of the eyes and the mouth are extracted, the controller 110 detects this and displays the positions of the extracted eyes and the mouth as the first to third regions as shown in FIG. 4A (f). Proceed. At this time, the first area indicates the position of the left eye, and consists of two points at the left and right ends of the left eyebrow and two points at the left and right ends of the left eye. Also. The second area indicates the position of the right eye, and consists of two points at the left and right ends of the right eyebrow and two points at the left and right ends of the right eye. In addition, the third area indicates the position of the mouth, and consists of two points at the left and right ends of the mouth and two points at the top and bottom ends of the lips.

If the correction is selected in step 205, the control unit 110 detects it in step 206 and proceeds to step 300 to correct the first to third areas.

Referring to FIG. 3, the modification process of the third region is described. When modification is selected in step 205, the controller 110 detects this in step 206 and opens the region modification menu as shown in FIG. The display proceeds to step 301.

If an area is selected in the area correction menu of step 301, the controller 110 detects it in step 302 and proceeds to step 303 to move to the corresponding area of the first to third areas. In the embodiment of the present invention, it will be described on the assumption that the area movement is performed through the up / down keys of the direction keys.

When the lower position key is input when the region position cursor is located in the second region as shown in (a) of FIG. 4B, the controller 110 senses this and the region position cursor as shown in (b) of FIG. 4B. The first area is moved and positioned. In addition, when the lower key is input in (b) of FIG. 4B, the controller 110 detects this and moves the area position cursor to a third area as shown in (c) of FIG. 4B.

As described above, whenever the lower key is input, (a) of FIG. 4B-> (b) of FIG. 4B-> (c) of FIG. 4B are repeated. In addition, whenever the upper key is input, (c) of FIG. 4B-> (b) of FIG. 4B-> (a) of FIG. 4B are repeated.

In addition, in step 303, the area movement process may be performed while performing a function of enlarging / reducing the picture through a predetermined key, for example, a volume up / down key.

If a point is selected in the region modification menu after the corresponding region is selected in step 303, the controller 110 detects it in step 304 and proceeds to step 305 to move to the corresponding point in the corresponding region where the region position cursor is located. In the embodiment of the present invention, it is assumed that the point movement is performed through the left / right keys among the direction keys.

(A)-(d) of FIG. 4C show a point movement process in the first region and a second region, and FIG. 4E-(h) show a process of point movement in the third region.

 First, as shown in (a) of FIG. 4, when the first point indicating the left end of the left eyebrow is activated among the four points forming the first area, when the right key is input, the controller 110 detects this. As shown in (b) of FIG. 4, the second point representing the right end of the left eyebrow is activated. In addition, when the right key is input in (b) of FIG. 4, the controller 110 detects this and activates a third point representing the left end of the left eye as shown in (c) of FIG. 4. In addition, when the right key is input in (c) of FIG. 4, the controller 110 detects this and activates a fourth point representing the right end of the left eye as shown in (d) of FIG. 4.

As described above, four points constituting the first area each time the right key is input are (a) of FIG. 4C-> (c) of FIG. 4C-> (c) of FIG. 4C-> (d) of FIG. 4C. As described above, the first point is activated while moving in the order of the fourth point. In addition, four points constituting the first area each time the left key is input are as shown in (d) of FIG. 4C-> (c) of FIG. 4C-> (b)-> 4C of FIG. 4C, The fourth point is activated while moving in the order of the first point. The process of selecting and moving to the corresponding point among the four points constituting the second area is the same as the process of selecting and moving to the corresponding point among the four points constituting the first area.

And, the process of moving the point in the third region through (e) to (h) of Figure 4, as shown in (e) of FIG. 4, the left end of the lips of the four points forming the third region When the first point indicating is activated, if the right key is input, the controller 110 detects this and activates the second point representing the upper end of the lips as shown in FIG. In addition, when the right key is input in (f) of FIG. 4, the controller 110 detects this and activates a third point representing the right end of the lips as shown in (g) of FIG. 4. In addition, when the right key is input in (g) of FIG. 4, the controller 110 detects this and activates a fourth point representing the lower end of the lips as shown in (h) of FIG. 4.

As described above, each time the right key is input, the four points forming the third area are (e) of FIG. 4C-> (f) of FIG. 4C-> (g) of FIG. 4C-> (h) of FIG. 4C. As described above, the first point is activated while moving in the order of the fourth point. In addition, four points constituting the first area each time the left key is input are as shown in (h) of FIG. 4C-> (G) of FIG. 4C-> (F) of FIG. 4C-> (C) of FIG. The fourth point is activated while moving in the order of the first point.

In operation 305, a process of selecting a corresponding point in the corresponding area may be performed while performing a function of enlarging / reducing the picture through a predetermined key, for example, a volume up / down key.

If a selection is input while the corresponding point is activated in the corresponding area in step 305, the controller 110 detects it in step 306 and proceeds to step 307 in the point correction menu. In this case, the selection of the activated corresponding point may be made through a center key among the direction keys.

4D illustrates a process of correcting the activated point, and in step 305, a process of activating and correcting a second point of a second area through an enlargement function of a picture.

As shown in (a) of FIG. 4D, after activating the second point of the second area, if the center key among the direction keys for selecting the second point is input, the control unit 110 detects this in step 306. As shown in (b) of FIG. 4D, the second point is changed to the movement display, and step 307 of displaying the point correction menu is performed.

If the movement is selected from the point correction menu, the controller 110 detects it in step 308 and proceeds to step 309 to move the movement indication of the second point to the corresponding position as shown in (c) of FIG. 4D. . At this time, the movement uses a four-way key, and the movement indication is moved in a direction corresponding to an input among the four directions.

In addition, if release of the point correction menu is selected, the controller 110 detects this in step 310 and proceeds to step 311 in which the movement indication of the second point moved in step 309 is moved to a previous position.

If a confirmation key is input during the process of moving the second point to the corresponding location in steps 309 and 311, the controller 110 detects this and then the second point as shown in (d) of FIG. 4D. In step 301, the movement display of the dot is displayed and the area correction menu is displayed.

In operation 309 and operation 311, the moving display may be moved and released while performing a zoom in / out function of the picture through a predetermined key, for example, a volume up / down key.

When the user corrects the error of the first to third regions through the process of FIG. 3, the controller 110 detects this and displays the type of facial expression. The facial expressions include sadness and anger. There may be murmur, happy, slim, plump and age facial expressions.

If the corresponding facial expression is selected from among the types of the facial expressions, the controller 110 detects it in step 207 and proceeds to step 208 in which the selected facial expressions are applied to the facial expressions of the photo and displayed.

In step 208, the controller 110 extracts the first to third regions of the selected facial expression and displays the first and third regions of the selected facial expression to correspond to the first to third regions of the photo. do.

Among the types of facial expressions, the slim / pain extracts an area of the ball part from the face extracted in step 203, and applies the ball partial area of the facial expression such as weather / pain to the extracted area of the ball part to be displayed. Can be.

If the comparison is selected after changing the facial expression of the photo to the selected facial expression through the step 208, the control unit 110 detects it in step 209 and simultaneously displays the original picture of step 201 and the changed picture in step 208. Proceed to step 210.

Alternatively, if the step adjustment is selected in step 208, the control unit 110 detects it in step 211 and proceeds to step 212 in which the face expression applied in step 208 is displayed step by step. If the facial expression of 'happy' is applied in step 208, whenever the step adjustment is input in step 212, the controller 110 changes the pixel value of the dots of the first to third areas to make the facial expression of 'happy'. Display step by step. In the embodiment of the present invention, it consists of four stage adjustments.

Alternatively, when the storage is selected in step 208, the controller 110 detects it in step 213 and proceeds to step 214 in which the changed picture is stored with the face expression selected in step 208.

5A to 5I are views illustrating a photo changed to the selected facial expression type through the process of FIG. 2.

FIG. 5A is an original photograph, and FIG. 5B is a photograph changed by applying a type of facial expression “surprise” to the facial expression of the original photograph of FIG. 5A, and FIG. 5C is a facial expression of the original photograph of FIG. 5A. The photo was changed by applying the facial expression type of 'smile' to.

In addition, FIG. 5D is a photo modified by applying a type of facial expression of sadness to the facial expression of the original photo of FIG. 5A, and FIG. 5E is a face of 'Smooth look' on the facial expression of the original photo of FIG. 5A. The photo is changed by applying facial expression.

In addition, FIG. 5F is a photo modified by applying a facial expression of 'angry' to the facial expression of the original photo of FIG. 5A, and FIG. 5G is a face of 'happy' in the facial expression of the original photo of FIG. 5A. The photo is changed by applying facial expression.

In addition, FIG. 5H is a photo changed by applying a facial expression type of 'thin' to the facial expression of the original photo of FIG. 5A, and FIG. 5I is a face of 'passage' to the facial expression of the original photo of FIG. 5A. The photo is changed by applying facial expression.

6 is a flowchart illustrating a process of extracting and storing facial expressions in a mobile terminal according to an embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to FIG. 1.

Referring to FIG. 6, when a corresponding picture is selected from among pictures stored in the memory 130 of the portable terminal, the controller 110 detects it and proceeds to step 501 of displaying the selected picture on the display unit 160.

If the facial expression storage is selected while displaying the corresponding picture selected in step 501, the controller 110 detects it in step 502 and proceeds to step 503 in which the face position is extracted from the picture. When the face position is extracted in step 503, the controller 110 proceeds to step 504 to extract the positions of eyes and mouth from the extracted face.

When the positions of the eyes and the mouth are extracted in step 504, the controller 110 detects this and proceeds to step 505 in which the positions of the extracted eyes and the mouth are displayed as the first to third regions. At this time, the first area indicates the position of the left eye, and consists of two points at the left and right ends of the left eyebrow and two points at the left and right ends of the left eye. Also. The second area indicates the position of the right eye, and consists of two points at the left and right ends of the right eyebrow and two points at the left and right ends of the right eye. In addition, the third area indicates the position of the mouth, and consists of two points at the left and right ends of the mouth and two points at the top and bottom ends of the lips.

If the correction is selected in step 505, the controller 110 detects it in step 506 and proceeds to step 300 to correct the first-third region. Step 300 of modifying the first to third regions is the same as the process of FIG. 3.

When the user completes the correction of the error of the first to third regions through the process of FIG. 3, the controller 110 detects this and displays the type of the storage name in step 507.

When the expression type is selected from the types of the stored names, the control unit 110 detects this in step 508 and stores the first to third areas displayed in step 505 or 300 as the stored names. Proceed to step.

Alternatively, when a direct input is selected among the types of the storage name, the controller 110 detects it in step 510 and stores the first to third areas displayed in step 505 or 300 as the storage name as the stored name. Proceed to step 511.

When the facial expressions are stored in steps 509 and 511, the one facial expression may be stored in stages by changing pixel values at points of the first to third regions. In this case, the step may be set by the user.

7 is a flowchart illustrating a process of generating and storing facial expressions in a mobile terminal according to an embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to FIG. 1.

Referring to FIG. 7, when a face expression is selected from a menu of the mobile terminal, the controller 110 detects it in step 601 and has a basic picture having a first to third regions indicating positions of eyes and mouth on the display unit 160. Proceed to step 602 to display.

At this time, the first area indicates the position of the left eye, and consists of two points at the left and right ends of the left eyebrow and two points at the left and right ends of the left eye. In addition, the second area indicates the position of the right eye, and consists of two points at the left and right ends of the right eyebrow and two points at the left and right ends of the right eye. In addition, the third area indicates the position of the mouth, and consists of two points at the left and right ends of the mouth and two points at the top and bottom ends of the lips.

If an area is selected in step 602, the controller 110 detects it in step 603 and proceeds to step 604 to move to a corresponding area among the first to third areas through input of a specific key for moving an area. In operation 604, a process of selecting a corresponding region from the first to third regions may be performed while performing a zoom in / out function of the photo through a predetermined key, for example, a volume up / down key.

If a specific key for moving a point is input after the corresponding area is selected in step 604, the controller 110 detects this in step 605 and the corresponding point among the four points forming the corresponding area through input of a specific key for moving the point. Proceed to step 606 to select. In operation 606, a process of selecting a corresponding point in the corresponding area may be performed while performing a zoom in / out function of the picture through a predetermined key, for example, a volume up / down key.

After the corresponding point is selected in step 606, if a certain operation value for changing the facial expression is selected or input in step 607, the controller 110 detects this value and the constant located around the point and the value of the pixel in which the point is located. In operation 608, the values of the pixels are calculated and displayed according to the operation value.

In step 608, if a selection is made among the pixel value at which the point is located and the pixel value at the periphery of the point are selected as the pixel value calculated for the expression change or input value, the selection is made. In step 609, the control unit 110 detects this and displays the pixel value at which the corresponding point is located and the pixel value at the periphery of the corresponding point as the calculated pixel value.

The operation value may be preset or an arbitrary value may be input by the user. The control unit 110 controls to calculate and display the pixel values by using a calculation value selected or input by the user through a specific calculation program. As described above, the user may generate a desired facial expression by changing a value of the pixels by calculating a value of a pixel at which the point is located and a value of pixels located at the periphery of the point as a predetermined calculation value.

If the expression completion is selected while changing the pixel value of the corresponding point in the corresponding area, the control unit 110 detects this in step 610 and selects or inputs the completed expression by the user. Proceed to step 611 to save the expression name.

8 is a flowchart illustrating a process of synthesizing facial expressions in a mobile terminal according to an embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to FIG. 1.

Referring to FIG. 8, when a corresponding picture is selected from the pictures stored in the memory 130 of the portable terminal, the controller 110 detects it and proceeds to step 701 in which the selected picture is displayed on the display unit 160. The photograph selected and displayed in step 701 is assumed to be a first photograph.

When face synthesis is selected while displaying the selected first picture in step 701, the controller 110 detects it in step 702 and proceeds to step 703 in which the face position is extracted from the first picture. If the face position of the first picture is extracted in step 703, the controller 110 proceeds to step 704 of extracting the positions of eyes and mouth from the extracted face.

When the positions of the eyes and the mouth of the first picture are extracted in step 704, the controller 110 detects this and displays the positions of the extracted eyes and the mouth as the first to third regions. At this time, the first area indicates the position of the left eye, and consists of two points at the left and right ends of the left eyebrow and two points at the left and right ends of the left eye. Also. The second area indicates the position of the right eye, and consists of two points at the left and right ends of the right eyebrow and two points at the left and right ends of the right eye. In addition, the third area indicates the position of the mouth, and consists of two points at the left and right ends of the mouth and two points at the top and bottom ends of the lips.

If the correction is selected in step 705, the controller 110 detects it in step 706 and proceeds to step 300 to correct the first-third region. Step 300 of modifying the first to third regions is the same as the process of FIG. 3.

After extracting the first to third regions from the first picture through steps 701 to 300, and selecting the corresponding picture from the memory 130 of the mobile terminal, the controller 110 detects the displayed picture and displays the selected picture in step 707. do. The photograph selected and displayed in step 707 is assumed to be a second photograph.

The controller 110 extracts the first to third regions from the second photo through steps 708 and 710, and steps 708 and 710 are performed in the same manner as steps 703 and 705. In addition, in step 710, steps 706 and 707 may be performed.

If the eyes and the mouth of the first picture are selected after the first-third region is extracted from the second picture, the control unit 110 detects this in step 711 and the first corresponding to the eyes and mouth of the first picture. In operation 712, a third region is applied to the first to third regions of the second photograph to be synthesized.

In addition, when the eyes and the mouth of the second picture are selected, the control unit 110 detects this in step 711 and selects the first-third area corresponding to the eyes and the mouth of the second picture first-first of the first picture. Step 712 is performed by applying the composition to the third region.

The eyes and mouth to be synthesized may be selected by a user, and the nose and ears as well as the eyes and mouth may be extracted and synthesized according to the face extraction.

In the above description of the present invention, a specific embodiment such as a mobile terminal has been described, but various modifications can be made without departing from the scope of the present invention. Therefore, the scope of the present invention should not be defined by the described embodiments, but should be determined by the equivalent of claims and claims.

That is, as described above, the present invention provides a method of editing an image of a mobile terminal, thereby changing and expressing facial expressions of a photo, extracting and storing facial expressions of a photo, and synthesizing and displaying the facial expressions of a photo. There is an effect that can provide a variety of services. In addition, the feature of the face detected in the face editing process as described above can be directly modified by the user can produce the desired expression accurately.

Claims (30)

In the image editing method in the mobile terminal, If the facial expression effect is selected while displaying a photo, the process of displaying the facial expression types, And changing a facial expression of the picture to a selected facial expression type among the facial expression types. The method of claim 1, wherein the changing of the facial expression of the photo is performed. Extracting a face from the photo; Specifying a region by extracting positions of eyes and mouth from the extracted face; And changing the extracted eye and mouth areas into eye and mouth areas according to the selected facial expression type. In the image editing method in the mobile terminal, If a facial expression effect is selected while displaying the photo, displaying the areas of the eye and mouth in the photo, and When the correction is selected for the regions, modifying the regions indicating the positions of the eyes and the mouth; And when the type of facial expression effect is selected, changing and displaying the facial expression of the picture with the selected facial expression. The method of claim 3, wherein the displaying of the areas of the eyes and the mouth in the picture is performed by: Extracting a face from the photo; Extracting the positions of eyes and mouth from the extracted face; And specifying a specific area at the positions of the eyes and the mouth to display the specific area. The method of claim 4, wherein the process of designating and displaying a specific area at the positions of the eyes and the mouth, Displaying a position of the left eye through a first area including two left and right ends of the left eyebrow and two left and right ends of the left eye; Displaying a position of the right eye through a second area including two left and right ends of the right eyebrow and two left and right ends of the right eye; And displaying the position of the mouth through a third region consisting of two points, the left and right end points of the mouth, and the upper and lower end points. The method of claim 3, wherein the modifying of the areas, When the correction for the regions is selected, displaying a region correction menu; Selecting a region from the region modification menu, selecting a region from among a first region displaying a left eye, a second region displaying a right eye, and a third region displaying a mouth; And when a point is selected in the region modification menu, a corresponding point is selected among the points forming the corresponding area, and the selected point is moved to a corresponding position. The method of claim 6, And selecting a corresponding region through an enlargement / reduction function when an region is selected from the region modification menu. The method of claim 6, And when a point is selected in the region modification menu, the corresponding point is selected through a zoom in / out function. The method of claim 6, wherein the moving of the selected point to a corresponding position comprises: Displaying a point correction menu when a corresponding point is selected among the points forming the corresponding area; If moving is selected from the point editing menu, moving the selected point to a corresponding position; And if release is selected from the point correction menu, releasing a movement of the point moved to the corresponding position. The method of claim 3, wherein the changing of the facial expression of the photo is performed. Extracting a first region displaying a left eye, a second region displaying a right eye, and a third region displaying a mouth from the selected facial expression; And applying the first-third region of the selected facial expression to the first-third region of the photo. The method of claim 3, If the comparison is selected after changing the facial expression of the photo, the process of displaying and comparing the original photo and the photo with the changed facial expression, If step adjustment is selected after changing the facial expression of the photo, displaying the facial expression applied to the photo step by step; And if storing is selected after changing the facial expression of the photo, storing the photo to which the facial expression is applied. In the image editing method in the mobile terminal, If a facial expression effect is selected while displaying a photo, displaying first to third regions designating eye and mouth positions in the photo; When the correction for the regions is selected, a corresponding region among the first to third regions is selected, a corresponding point among the points constituting the selected region is selected, and the selected point is moved to a corresponding position to move the selected region to the corresponding position. 3 process of modifying and displaying the area, And when the type of face expression effect is selected, applying the first to third areas of the selected face expression to the first to third areas of the picture to display the changed face expression of the picture. The method of claim 12, The first area includes two left and right ends of the left eye and two left and right ends of the left eye, and the second area is two right and left ends of the right eyebrow and two right and left ends of the right eye. Wherein the third region is characterized in that the area consisting of two points of the left and right end and two points of the upper and lower ends of the mouth. The method of claim 12, And modifying the first to third areas through a zooming function. In the image editing method in the mobile terminal, If the facial expression storage is selected while displaying the photo, the process of extracting the position of the eyes and mouth in the photo to display the areas; Modifying the areas, selecting the areas indicating the positions of the eyes and mouth; And storing the facial expression of the extracted photo when the storage of the facial expression of the photo is selected. The method of claim 15, wherein the extracting the positions of the eyes and the mouth from the photo and displaying the positions are as areas. Extracting two left and right end points of the left eyebrow and two left and right end points of the left eye, and displaying the position of the left eye through the extracted first region; Extracting two left and right end points of the right eyebrow and two left and right end points of the right eye, and displaying the position of the right eye through the extracted second region; And extracting two left and right end points and two upper and lower end points of the mouth, and displaying the position of the mouth through the extracted third region. The method of claim 15, wherein the modifying the regions, When the correction for the regions is selected, displaying a region correction menu; Selecting a region from the region modification menu, selecting a region from among a first region displaying a left eye, a second region displaying a right eye, and a third region displaying a mouth; And when a point is selected in the region modification menu, a corresponding point is selected among the points forming the corresponding area, and the selected point is moved to a corresponding position. The method of claim 17, And if the correction is selected for the regions, modifying the first to third regions through a zooming function. The method of claim 15, And if the storage for the facial expression of the photo is selected, the eye and mouth regions extracted from the photo are stored. The method of claim 15, The expression of the extracted picture is characterized in that for storing as an input and the selected facial expression name. In the image editing method in the mobile terminal, Displaying a basic picture having regions indicating the positions of eyes and mouth when making a facial expression is selected in the mobile terminal; Generating a facial expression while changing a pixel value of a corresponding point in a corresponding area in the basic picture. The method comprising the step of storing the generated facial expression. The method of claim 21, The basic photograph is a first area consisting of two left and right ends of the left eyebrow and two left and right ends of the left eye to indicate the position of the left eye, two left and right ends of the right eyebrow to represent the right eye, and And a third region consisting of two left and right end points and two upper and lower end points of the mouth to represent the mouth. The method of claim 21, wherein the process of generating the facial expression, Selecting a corresponding region from a first region displaying a left eye, a second region displaying a right eye, and a third region displaying a mouth in the basic picture; If a corresponding point is selected among the points constituting the corresponding area in the selected corresponding area, the step of calculating and changing the value of the pixel in which the point is located and the value of the pixels located in the periphery of the corresponding point Way. The method of claim 23, wherein The method of generating the expression is characterized in that through the enlargement / reduction function. In the image editing method in the mobile terminal, If the facial matchability is selected, extracting the positions of the eyes and mouth in the selected first and second photos, respectively, Optionally, the method comprising the step of applying the eye and mouth of the first picture to the second picture, or applying a picture of the eye and mouth of the second picture to the first picture to synthesize. The method of claim 25, wherein extracting the positions of the eyes and the mouth from the first and second photos, respectively, If the first picture is selected, extracting the positions of eyes and mouth from the first picture and displaying them as regions; If the correction is selected for the areas of the first picture, correcting the areas indicating the positions of the eyes and the mouth; If the second picture is selected, extracting the positions of eyes and mouth from the second picture and displaying them as regions; And correcting the regions of the second photo, modifying the regions indicating the positions of the eyes and the mouth. 27. The method of claim 26, wherein extracting and displaying positions of the eyes and the mouth as regions, Extracting two left and right end points of the left eyebrow and two left and right end points of the left eye, and displaying the position of the left eye through the extracted first region; Extracting two left and right end points of the right eyebrow and two left and right end points of the right eye, and displaying the position of the right eye through the extracted second region; And extracting two left and right end points and two upper and lower end points of the mouth, and displaying the position of the mouth through the extracted third region. The method of claim 26, wherein modifying the regions, When the correction for the regions is selected, displaying a region correction menu; Selecting a region from the region modification menu, selecting a region from among a first region displaying a left eye, a second region displaying a right eye, and a third region displaying a mouth; And when a point is selected in the region modification menu, a corresponding point is selected among the points forming the corresponding area, and the selected point is moved to a corresponding position. The method of claim 28, And modifying the first to third areas through a zooming function. The method of claim 25, wherein the synthesis process, When the eyes and the mouth of the first picture are selected, synthesizing the areas of the eyes and the mouth of the first picture by applying the areas of the eyes and the mouth of the second picture; And when the eyes and mouths of the second picture are selected, applying the areas of eyes and mouths of the second picture to the areas of eyes and mouths of the first picture.

Images