KR20100000936A - Method and mobile communication terminal for processing individual information - Google Patents

Abstract

PURPOSE: A method and a mobile communication terminal for processing individual information are provided to detect a face element from a photographed image, thereby storing individual information corresponding to the face element. CONSTITUTION: A controller(120) identifies a face element from an output image. The controller shows identification marking of a face for the coordinates of the face element. The controller activates an individual information input menu corresponding to the face element. A storage unit(130) stores the input individual information within a data file of an image.

Description

Person information processing method and mobile communication terminal performing the same {Method and mobile communication terminal for processing individual information}

The present invention relates to a person information processing method and a mobile communication terminal performing the same, and more particularly, a person information processing method using the same and storing the person information corresponding to the coordinates of the identified face by identifying the face on the image and the same. It relates to a mobile communication terminal to perform.

Recently, mobile communication terminals have been spread with various additional functions such as media players, cameras, dictionaries, calendars, as well as their original functions as communication devices for call functions. That is, users of the mobile communication terminal can use the mobile communication terminal for banking, shopping, taking pictures, and even schedule management. For this purpose, various modules such as a camera and a smart card are mounted in the mobile communication terminal.

Among them, the performance of the camera module is increasing day by day so that the performance of the camera module becomes the most important consideration when purchasing a mobile communication terminal.

In fact, the camera module included in the mobile communication terminal is improved so that the user does not need to purchase a separate digital camera, and users can take pictures or acquaintances by using the camera module included in the mobile communication terminal. There are many cases.

Nevertheless, it is true that the interworking function between the camera module and the mobile communication terminal is very insufficient. That is, the camera module included in the mobile communication terminal is developed only in the camera's original functional parts such as the number of pixels and the image stabilization function, and the characteristics of the camera module included in the mobile communication terminal are not reflected.

For example, the mobile communication terminal stores phone numbers, addresses, and e-mail addresses of acquaintances in a phonebook, and can easily send voice calls or text messages to acquaintances through shortcut keys. This feature is difficult to support in digital cameras.

In particular, images taken by using a camera module included in the mobile communication terminal may include many portraits of acquaintances. However, the conventional mobile communication terminal does not connect it with the original function of the mobile communication terminal.

The present invention has been made to solve the above-mentioned shortcomings of the prior art, by identifying the face on the image to store the person information corresponding to the coordinates of the identified face and the person information processing method using the same and a mobile communication terminal performing the same The purpose is to provide.

Other objects of the present invention will become more apparent through the preferred embodiments described below.

According to an aspect of the present invention for achieving the above object, there is provided a person information processing method.

According to an embodiment of the present invention, in the method for processing person information of a mobile communication terminal including a camera module and a display unit, (a) recognizing a face element in an image captured by the camera module and output through the display unit; ; (b) displaying an identification mark of the face on coordinates of the face element recognized on the image; (c) activating a person information input menu corresponding to the face when receiving a signal for selecting an identification mark of the face from a user of the mobile communication terminal; (d) storing the person information input through the person information input menu in the data file of the image using the coordinates of the face as metadata; And (e) when the image data file in which the person information is stored is displayed, displaying the person information according to the user's person information selection input.

In step (d), the person information may be stored as voice or text.

In the step (a), the face recognized in the image may be a plurality, and the step (b) may be a step of displaying an identification mark of each face in each coordinate region of the plurality of faces on the image.

The display unit may be a touch screen in which an input unit is integrally formed. In step (c), a signal for selecting an identification mark of the face may be generated by contact in the coordinate region of the image detail displayed on the touch screen. .

In the step (d), the person information may be connected to telephone number information connected through a pointer for designating an area of a phone book included in the mobile communication terminal.

The person processing method comprises the steps of: (f) displaying the telephone number information; And (g) performing one of a voice call, a text message, and a multimedia message transmission according to the selection of the phone number information.

According to an aspect of the present invention for achieving the above object, a mobile communication terminal is provided.

According to an embodiment of the present invention, a mobile communication terminal for processing person information comprises: a camera module; A display unit; A controller configured to capture a face element in the image captured by the camera module, display an identification mark of the face in coordinates of the face element, and activate a person information input menu corresponding to the face element; And a storage unit in which the person information input through the person information input menu is stored in the data file of the image using the coordinates of the face as meta data, wherein the image data file in which the person information is stored is displayed. A mobile communication terminal is provided comprising the step of displaying the person information according to the user's person information selection input.

According to an aspect of the present invention for achieving the above object, a mobile communication terminal is provided.

According to an embodiment of the present invention, a recording medium in which a program for implementing a method of processing person information in a mobile communication terminal including a camera module and a display unit is recorded. (A) The image is captured by the camera module and output through the display unit. Recognizing a face element in the captured image; (b) displaying an identification mark of the face on coordinates of the face element recognized on the image; (c) activating a person information input menu corresponding to the face when receiving a signal for selecting an identification mark of the face from a user of the mobile communication terminal; (d) storing the person information input through the person information input menu in the data file of the image using the coordinates of the face as metadata; And (e) when the image data file in which the person information is stored is displayed, displaying the person information according to the user's person information selection input. This recorded recording medium is provided.

As described above, according to the present invention, by detecting a face element in an image captured by a camera included in the mobile communication terminal, it is possible to store personal information corresponding to the face element, and a communication service is provided for each face element on the image. It can be interlocked.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and in describing the present invention with reference to the accompanying drawings, the same or corresponding components are given the same reference numerals regardless of the reference numerals. Duplicate explanations will be omitted.

1 is a block diagram showing the internal configuration of a mobile communication terminal according to an embodiment of the present invention.

Referring to FIG. 1, the mobile communication terminal 100 according to an embodiment of the present invention includes a camera module 110, a controller 120, a storage 130, a display 140, and an RF module 150. do.

Other antennas, speakers, microphones, key buttons, etc. included in the mobile communication terminal are omitted from the drawings to clarify the gist of the present invention, and the baseband signal processing unit is included in the control unit, and the wireless signal transmission antenna, duplexer, power amplifier, It is assumed that the RF module is included in an internal oscillator, a filter circuit, and the like.

The camera module 110 is a compact camera module including an illumination system lens group including a plurality of micro lenses, an outer case, an image sensor, and the like. However, it is obvious that the camera module 110 may further include an IR light source, an LED flash, an optical zoom lens, and the like.

When the camera module 110 is implemented as a key button or a touch screen of the mobile communication terminal 100, the camera module 110 is connected to a soft button on the touch screen to capture an image by the user of the mobile communication terminal 100.

That is, an image signal is generated for each pixel to the image sensor through the illumination system lens group, and the image signal is transmitted to the controller. The image signal for each pixel becomes an image captured by the camera module 110.

The controller 120 included in the mobile communication terminal 100 of the present invention determines whether a face element of a person exists in the received video signal. As described above, the control unit 120 may include a baseband signal processing unit of the mobile communication terminal 100, but the control unit 120 is separate from the baseband signal processing unit for the communication function of the mobile communication terminal 100. It may be a calculation circuit. That is, the mobile communication terminal 100 may include a host processor for a communication function and an image processing processor for image processing of a camera module, respectively.

The controller 120 determines whether a face element of a person exists in the captured image. The method of determining a face element of a person determines whether a preset image element pattern exists on an image.

In general, the face of a person is pitted at three points of eyes and mouth, and the nose and cheekbones are protruded, resulting in a difference in pixel values. Therefore, the control unit according to an embodiment of the present invention determines that the difference between the coordinates of the two eyes, the two cheekbones of the nose, the pixel values in the nose and the mouth as described above is a face element. In more detail, X = 1, Y = 45 (less than 50 pixel left eye), X = 28, less than Y = 45 (50 pixel right eye), X = 14, Y = 3 ~ 24 In case of satisfying the pixel value difference pattern by coordinates (pixel value of nose of 100 or more), X = 3 to 22, and Y = 32 (pixel value of mouth of 70 or less), the face element judgment criteria are set in advance to recognize as a face element. It may be.

However, the above-described face element determination criteria are merely examples for explaining the present invention, and other face element determination criteria may be applied.

The controller 120 outputs an identification mark of the face along with the image to the face element through the display 140. As described above, the identification mark of the face is displayed on the coordinates that the controller 120 has already determined as the face element on the ground.

Therefore, a rectangular or circular dotted line may be displayed on the face element on the image displayed through the display 140. However, the format of the identification mark of the face described above is not limited thereto and may be displayed through various figures or pointers. This will be described in detail with reference to FIG. 3.

As a result of the determination of the controller 120, if three face elements exist in the image, all three face identification marks are displayed on the image. The user selects an identification mark of a desired face through input means such as a key button of the mobile communication terminal 100.

The controller 120 receives a signal by selecting an identification mark of a user's face to activate a person information storage menu. In the person information storage menu, submenus such as name storage, voice memo, and text memo may be displayed. Through such a menu, the user may store person information of a person corresponding to the selected face element.

For example, you can save the name 'Kim Chul-soo'. If you select Voice Memo, you can save the voice memo 'Kim Chul-su is 00 University 00 Department No. 00 Student.'

In the case of the voice memo, it is transmitted to the control unit 120 through the speaker of the mobile communication terminal 100, and the control unit 120 has various formats such as EVRC (Enhanced Variable Rate Codec) and QCELP (Qualcomm Code Excited Linear Prediction). Can convert to voice data. The controller 120 stores the converted voice data and the name in the extended area of the image.

For example, if the image is a JPEG-format data file, voice data of EVRC, QCELP format and text data of 'Kim Chul-soo' are added to the extended or reserved field of the JPEG as metadata of the face element. do.

As described above, the image file to which the voice data and the text data are added is stored in the storage unit 130 included in the mobile communication terminal 100 of the present invention.

However, when the extended area does not exist in the image file, the above-described image data file is stored, and the voice data and the text file are stored in a separate reference file separate from the image data file. In this case, the reference file includes the file name of the image file and the coordinates of the face element.

Therefore, when the user subsequently outputs the image stored in the storage unit 130 to the display unit 140 through the mobile communication terminal 100, the control unit 120 or the name corresponding to the coordinates of the face element of the image or The audio data output or playback menu can be displayed. This will be described in detail with reference to FIGS. 4 to 5.

2 is a flowchart illustrating a person information processing method according to an embodiment of the present invention.

Referring to FIG. 2, the mobile communication terminal 100 recognizes a face in an image captured by the camera module 110 (S200). For example, assuming that a family picture including itself is taken using the user mobile communication terminal 100, the image includes three face elements.

Therefore, the mobile communication terminal 100 recognizes three face elements. Although there are differences depending on people, as shown in FIG. 1, pixel values change according to eyes, nose, cheekbones, and mouth. Therefore, pixel values change according to coordinates in the image. In case of coinciding with, the face element can be recognized.

The mobile communication terminal 100 recognizes the recognized facial elements. The identification mark of the face is shown in the coordinates corresponding to the face element on the image (S210). The identification mark of the face may be displayed in various ways such as a figure such as a rectangle or a circle or a dotted line.

Thereafter, the mobile communication terminal receives an input through which the user selects one of the face elements displayed on the image through the input unit of the mobile communication terminal (S220). That is, the user may select a face of a desired person from among the face elements by using a key button of the mobile communication terminal, or in the case of including a touch screen, the user may select a face of the desired person by touching a corresponding coordinate with a finger.

When the mobile communication terminal 100 receives the face element selection input input by the user, the mobile communication terminal 100 displays a person information storage menu (S230). The person information storage menu may include submenus such as name saving, voice memo, and text memo.

The user may select one of submenus such as name storage, voice memo, and text memo to allow the mobile communication terminal 100 to insert and store desired person information in the image data file (S240).

In this case, in step S240, the mobile communication terminal 100 does not store only the person information in the extended area or the reserved field of the image data file, but uses the above-described coordinates of the face elements as meta data (Tag). Save it.

Accordingly, when the image file stored by the user's mobile communication terminal 100 is output to the display unit 140, the person information stored in step S240 may be output to the coordinates of the corresponding face element.

The method of the present invention as described above may be implemented in a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.).

3 is a diagram illustrating an example in which the person information processing method described in FIG. 2 is applied.

Referring to FIG. 3, the image captured by the camera module of the mobile communication terminal is output to the display unit of the mobile communication terminal 100 on the left side. Three people are included in the image.

The mobile communication terminal of the present invention recognizes three face elements as described in FIGS. The method of recognizing a face element is the same as described above, and thus will be omitted.

Therefore, the dotted lines A, B, and C of the face, which are identification marks of the face, are displayed on the face elements of the image output through the display unit. However, the form of the identification mark of the face is not limited thereto, and it may be apparent that the face may be displayed in a circle or another figure.

In addition, a finger-shaped pointer 200 for selecting a face identification mark is output on the side of the face identification mark A. FIG. The pointer 200 is set to be adjusted so that the user moves by using the side key button of the mobile communication terminal.

When the user places the pointer 200 on the face identification mark A and selects the face identification mark A using a selection key button or the like, the person information storage menu 210 is output on the side of the face identification mark A. do.

The person information storage menu 210 includes a sub menu such as name storage, phone number storage, phone book view, person voice recording, and the like. This is illustrated through the display unit of the mobile communication terminal 100 shown on the right side of the figure.

Therefore, when the user selects "1. Save name", the text creation window is activated to write a name, and the user writes a name such as "My husband", "Kim Chul-soo" and saves the name by pressing the "OK" key button. Can be. In this case, the name "my husband" is stored using tag information (or metadata) as a coordinate region (for example, X = 45, Y = 90) of the face element A of the image data file.

Therefore, when the same image data file is output through the display unit, the person information “My husband” may be output together in the coordinate region of the face element A. FIG.

In the above example, the name is stored as the person information. However, as described with reference to FIGS. 1 and 2, not only a name but also a voice recording and a text memo may be used.

In addition, when connected to "2. Save phone number", the phone book menu is activated, and when entering a phone number and storing it with a name, the selected face element A may be registered as a portrait of the corresponding phone number in the phone book. have.

In addition, when the sub-menu of "3. View Phone Book" is selected, the Phone Book is activated, and the user may correlate person information, such as a phone number, stored in advance through the Phone Book Menu, to the identification mark A of the face. That is, the path information of the image and the coordinates of the face element A are stored in the portrait field provided separately in the phone book menu, so that each menu can be output when the image is output or the phone book is output. This will be described in detail with reference to FIG. 5.

4 is a flowchart illustrating a person information processing method according to another embodiment of the present invention.

The flowchart of FIG. 4 assumes that the person information for the person element selected by the procedure described with reference to FIG. 2 is stored in an extended area of the image data file or a separate reference file, and then the image data file is output by the user. It is assumed.

First, an image data file stored in the storage unit is read through a key button input of the user's mobile communication terminal 100 (S300).

The mobile communication terminal 100 of the present invention determines whether there is person information stored from an extended area of the image data file (S310). That is, as described with reference to FIGS. 2 to 3, it is determined whether face information is selected from among the face elements recognized and displayed by the mobile communication terminal 100 of the present invention. Or, it is determined whether a reference file of the image data file exists to determine whether person information is stored in the reference file.

In this case, the mobile communication terminal 100 reads out a coordinate value stored as meta data (tag information) in the already stored person information and displays the person at the position of the corresponding coordinate value (S320).

Thereafter, the mobile communication terminal 100 outputs all or part of the person information stored on the side of the person display. For example, if the name "my husband" is stored, the text "my husband" is displayed on the side of the face identification mark. If a text memo about the phone number or the person is stored, the phone number and the text memo may be displayed together with the text "My husband".

In addition, when the voice memo for the person is stored, the mobile communication terminal 100 may output a play button (soft button) for playing the stored voice or may further output a menu called “play”.

The mobile communication terminal 100 according to an embodiment of the present invention may further provide an interworking service menu that interworks with the person information (S330). Interworking service is a service that provides the communication function of the call function, message function, email transmission function of the mobile communication terminal to the face element.

That is, the mobile communication terminal 100 further outputs a submenu such as a call function, a message transmission, and the like at the bottom of the face element labeled "My husband". Then, if the user selects a sub-menu called "call connection" or "call", the call setup request message is transmitted to the stored phone number with the name "my husband" and the voice call is performed (S360).

Such names and phone numbers may be stored in the phone book as described above and associated with facial elements in the image.

In addition, when the user selects a submenu called "Write a message", the mobile communication terminal 100 of the present invention may output a message preparation window in which a phone number stored as person information is inserted in the receiver of the message in advance. .

Accordingly, the user composes a message, and presses a call button or an OK button, so that the mobile communication terminal 100 transmits the message to a phone number which is person information.

However, if there is no person information in step S310 to recognize the face element in the image (S340). As a method of recognizing a face element, a method of recognizing a face element may be used by comparing pixel values such as eyes, nose, cheekbones, and nose as described with reference to FIGS. 1 and 2.

In this case, an identification mark of the face is displayed on the newly recognized face element, and as described above with reference to FIG. 2, the person information corresponding to the desired face element may be stored (S350). This may be applied when a user takes a picture using the mobile communication terminal 100 of the present invention and immediately stores it as an image data file, and then retrieves and edits the image data file from the photo editing menu.

Alternatively, when there are a plurality of face elements recognized by the mobile communication terminal 100, when only one face element is selected by the user as described above with reference to FIGS. 2 to 3 and the person information is stored, the remaining faces are performed after step S320. The process may proceed to step S340 to recognize and output the region.

The method of the present invention as described above may be implemented in a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.).

5 is a diagram illustrating an example in which the person information processing method described in FIG. 4 is applied.

Referring to FIG. 5, the mobile communication terminal 100 shown on the left side of the drawing shows a screen that reads an image data file storing person information corresponding to a face element and outputs the image data file to a display unit.

That is, in the image data file including the three face elements described with reference to FIG. 3, the name 300 and the phone number of the person information are displayed on the side of the face element A in which the name 300 and the phone number 310 are stored. 310 is output together.

At the bottom of the name 300 and the telephone number 310, the interworking service submenu described with reference to FIG. 4 may be output together. However, "calling" is merely an example of an interlocking service provided by the mobile communication terminal 100 according to the person information, and another interlocking service submenu such as message transmission and e-mail transmission may be further provided. Is self-explanatory.

Therefore, the user may view the image data file stored in the storage unit and check the information on the person through the person information output for each face element, and may contact the other party such as a phone call or a message transmission.

For example, when a user selects "Call" using a side key button of a mobile communication terminal and inputs a confirmation button, the user stores the corresponding face element as shown in the mobile communication terminal shown on the right side of FIG. Send call setup request message to phone number. Therefore, the user can try to talk to her husband.

Although the above has been described with reference to the embodiments of the present invention, those skilled in the art may variously modify and modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. It will be appreciated that it can be changed.

1 is a block diagram showing the internal configuration of a mobile communication terminal according to an embodiment of the present invention.

2 is a flowchart illustrating a person information processing method according to an embodiment of the present invention.

3 is a diagram illustrating an example in which the person information processing method described in FIG. 2 is applied;

4 is a flowchart illustrating a person information processing method according to another embodiment of the present invention.

5 is a diagram illustrating an example in which the person information processing method described in FIG. 4 is applied;

Claims (8)

In the human information processing method of a mobile communication terminal including a camera module and a display unit, (a) recognizing a face element in an image captured by the camera module and output through the display unit; (b) displaying an identification mark of the face on coordinates of the face element recognized on the image; (c) activating a person information input menu corresponding to the face when receiving a signal for selecting an identification mark of the face element from a user of the mobile communication terminal; (d) storing the person information input through the person information input menu in the data file of the image using the coordinates of the face as metadata; And (e) when the image data file storing the person information is displayed, displaying the person information according to the user's person information selection input. The method of claim 1, In step (d) Person information processing method characterized in that for storing the person information as voice or text. The method of claim 1, In the step (a) There are a plurality of faces recognized in the image, Step (b) is And displaying an identification mark of each face in each coordinate area of the plurality of faces on the image. The method of claim 1. The display unit is a touch screen in which the input means is integrally formed. In the step (c), And a signal for selecting an identification mark of the face is generated by a contact in the coordinate region of the image detail displayed on the touch screen. The method of claim 1, In step (d) And the person information is connected with telephone number information connected through a pointer for designating an area of a phone book included in the mobile communication terminal. The method of claim 5, The character processing method (f) displaying the telephone number information; And (g) performing any one of a voice call, a text message, and a multimedia message transmission according to the selection of the phone number information. In the mobile communication terminal for processing person information, Camera module; A display unit; A controller configured to capture a face element in the image captured by the camera module, display an identification mark of the face in coordinates of the face element, and activate a person information input menu corresponding to the face element; And  The person information input through the person information input menu includes a storage unit for storing the coordinates of the face as metadata in the data file of the image. And displaying the person information according to the user's person information selection input when the image data file storing the person information is displayed. Claims [1] A recording medium having recorded thereon a program for implementing a method of processing person information in a mobile communication terminal including a camera module and a display unit. (a) recognizing a face element in an image captured by the camera module and output through the display unit; (b) displaying an identification mark of the face on coordinates of the face element recognized on the image; (c) activating a person information input menu corresponding to the face when receiving a signal for selecting an identification mark of the face from a user of the mobile communication terminal; (d) storing the person information input through the person information input menu in the data file of the image using the coordinates of the face as metadata; And (e) when the image data file in which the person information is stored is displayed, displaying the person information according to a user's person information selection input. The recorded recording medium.

Images