KR20130132189A - Operation method based on a portrait photo and device supporting the same - Google Patents

Abstract

The present invention relates to a portrait photo management function on a terminal device and, particularly, to a method for managing portrait photos and a terminal device supporting the same. The method for managing portrait photos is characterized by comprising the following steps: outputting at least one portrait photo to a display unit in response to user input; recognizing at least one face included in the outputted portrait photo; comparing the recognized at least one face with at least one database including face information, phonebook information, and collected social network record information; and performing a given user function related to the recognized at least one face based on the comparison result with the database or displaying at least one among a graphic element and an display item, wherein the graphic element facilitates the selection of the recognized face in order to manually operate the given user function, and the display item helps the given user function to be performed. [Reference numerals] (110) Communication unit;(120) Input unit;(130) Audio processing unit;(140) Display unit;(150) Storage unit;(151) Phonebook database;(153) Portrait photo database;(155) Portrait photo management program;(157) Face recognition algorithm;(159) Photo search database;(160) Control unit;(200) Social network

Description

Operation Method based on a Portrait Photo and Device supporting the same}

The present invention relates to a function for operating a portrait picture of a terminal, and in particular, to display a variety of information on a portrait picture, to create new content, or to easily share a portrait picture with others. The present invention relates to a method of operating a portrait photography that can be easily performed and a terminal supporting the same.

The portable terminal has provided functions corresponding to each function in order to provide various functions required by the users. For example, the conventional portable terminal includes a camera, and provides a specific function of separately storing and managing a picture taken by a camera or a picture received from the outside, and searching the same. In addition, the conventional portable terminal stores and manages the telephone numbers of other terminals and provides the telephone numbers that the user requests for calls with other terminals. As described above, the conventional mobile terminal provides various function items for supporting a specific function requested by a user, and performs the corresponding function support based on this.

However, each of the provided functions is provided on the basis of the developer who develops the corresponding function. Therefore, the accessibility and the operability of the user are weak. For example, in the case of providing a conventional phone number, a user checks and calls a specific phone number and user name provided on a text basis, but does not accurately remember the phone number and user name provided on a text basis. In the case of failure, the data is essentially information that is meaningless to the user. As such, since the terminal supports functions based on text information that is not easy for a user to remember and has a lot of confusion, it is difficult to support appropriate user operability, and thus, user friendly and user operability improved function support is required. .

Accordingly, an object of the present invention is to solve the problems of the prior art as described above, a portrait photography operating method that can support to perform a variety of terminal functions based on a portrait photo corresponding to an image with excellent recognition and the same In providing a supporting terminal.

According to an aspect of the present invention, there is provided a method of outputting at least one portrait picture to a display unit in response to a user input, recognizing at least one face included in the output portrait picture, and at least one recognized image. Comparing a face to a database including at least one face information, phonebook information, and collected social network record information, and referring to the comparison result with the database to automatically identify a specific user function associated with the recognized at least one face. Displaying at least one of a graphic element for selecting the recognized face for performing the manual operation of the specific user function or a separate display item for supporting the specific user function; Configuration of the portrait photography operating method characterized in that The deadline.

The present invention also includes a display unit for outputting at least one portrait picture in response to a user input, recognizing at least one face included in the output portrait picture, and recognizing the at least one face with at least one face information. Automatically performing a specific user function related to the recognized at least one face with reference to a comparison result with a database including phonebook information and collected social network record information, or recognizing the user for manual operation of the specific user function. And a control unit configured to display at least one of a graphic element for selecting a corrected face and a separate display item for supporting the specific user function. Initiate.

As described above, according to the method for operating a portrait photography according to the present invention and a terminal supporting the same, the present invention supports an easy and various operation of a user function of the terminal based on the portrait.

For example, the present invention supports reproducing various contents based on face areas included in a portrait picture, and may provide various information related to the person on the portrait picture, and share the portrait picture more easily. To help.

1 is a view schematically showing the configuration of a terminal supporting a portrait photography operation function according to an embodiment of the present invention.
2 is a more detailed view of the configuration of the control unit of Fig.
3 is a diagram illustrating an example of a screen interface for explaining a group tagging function among a portrait photography operating function according to a first embodiment of the present invention;
4 is a diagram illustrating an example of a screen interface for explaining a photo sharing function among a portrait photography operating function according to a second embodiment of the present invention;
FIG. 5 is a diagram illustrating an example of a screen interface for explaining a social information support function of a portrait photography operation function according to a third embodiment of the present invention; FIG.
6 is a view for explaining a terminal operation for supporting a portrait photography operating method according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In the following description of the embodiments of the present invention, descriptions of techniques which are well known in the technical field of the present invention and are not directly related to the present invention will be omitted. In addition, detailed description of components having substantially the same configuration and function will be omitted.

For the same reason, some of the elements in the accompanying drawings are exaggerated, omitted, or schematically shown, and the size of each element does not entirely reflect the actual size. Accordingly, the present invention is not limited by the relative size or spacing depicted in the accompanying drawings.

1 is a diagram schematically illustrating a configuration of a terminal supporting a portrait photography operation function according to an exemplary embodiment of the present invention.

1, the terminal 100 of the present invention includes a communication unit 110, an input unit 120, an audio processing unit 130, a display unit 140, a storage unit 150, and a controller 160 .

The terminal 100 of the present invention having such a configuration recognizes the faces of people included in the corresponding person photo based on the at least one person picture stored in the storage unit 150, and based on the recognized faces, new content. It supports the function to automatically generate the. In addition, the terminal 100 of the present invention collects various information of the user corresponding to the recognized face, and supports to output the collected information to a predetermined position on the portrait. In addition, the terminal 100 of the present invention supports the transmission of the pictures to other terminals related to the user corresponding to the recognized face, thereby making it easier to share the pictures.

To this end, the communication unit 110 may support a communication function of the terminal 100, and the terminal 100 may be configured as a mobile communication module supporting a mobile communication function. In particular, the communication unit 110 may support a specific communication channel formation and data transmission / reception in order to support a function of sharing a portrait picture and a function of collecting and providing various information on a network recorded by a user of a recognized face. For example, the communication unit 110 forms a communication channel with the social network 200 including a specific social network service device used by the user of the face included in the portrait picture, and corresponds to the portrait picture from the social network 200. Can receive the information recorded by the user. The received record information may be stored in the storage unit 150 under the control of the controller 160 and then output to the display unit 140 under the control of the controller 160.

In addition, when the communication unit 110 instructs the terminal user to share a specific person picture specified by the terminal user, at least one of the terminal corresponding to the faces included in the person picture and the communication service device used by the user of the recognized face A communication channel can be established to transmit a picture. For example, the communicator 110 may establish a data communication channel with the terminals of each person's pictures and support data transmission of the person's picture according to a specific communication method.

The input unit 120 generates various input signals required for the operation of the terminal 100. The input unit 120 may include various input means such as a keyboard, a keypad, and a key button depending on whether the terminal 100 is compatible or not. In addition, the input unit 120 may be configured in the form of a virtual touch map that is output to the touch screen when the display unit 140 is provided as a touch screen. For example, the input unit 120 may be configured in at least one of various key maps such as a 3 * 4 key map, a 5 * 4 key map, a qwerty key map, a dvorak key map, and the like. In particular, the input unit 120 may include an input signal for activating the portrait photography operation function of the present invention, an input signal for selecting a specific portrait photo, a content regeneration function based on the selected portrait photo, and a social network 200 or a phonebook database ( An input signal for activating a function of providing information related to the portrait photography based on 151 may be generated. In addition, the input unit 120 may generate an input signal for sharing the portrait picture with other terminal users, and at this time, each or all of the faces recognized to share the picture with specific people included in the portrait picture at once. You can create an input signal that you specify. Meanwhile, the above-described input signals may be performed on the display unit 140 including the touch panel, and thus the input signals may be generated in the form of a touch event. The input signal generated by the input unit 120 may be transmitted to the controller 160 and operate as a command for performing a function according to each input signal.

The audio processing unit 130 may output various audio data set in the operation of the terminal 100 and audio data corresponding to audio file playback stored in the storage unit 150 and audio data received from the outside. In addition, the audio processing unit 130 may support an audio data collection function. For this, the audio processing unit 130 may include a speaker SPK and a microphone MIC. In particular, the audio processor 130 may support the output of various guide sounds or sound effects provided during the portrait photo search process. For example, when the portrait photo operation function is activated to recognize each face included in the portrait photo, the user may output a guide sound or an effect sound according to the face recognition result, and the phone book database in which the recognized face photo is registered. The person's name 151 may be output as an audio signal. In addition, the audio processor 130 may output a predetermined or default background music or a narration when the content reproduced by the at least one specific person photo is reproduced. In addition, the audio processor 130 may support output of a guide sound or an effect sound according to whether or not the photo transmission is completed when the photo sharing function is performed. The audio signal output of the audio processor 130 described above may be omitted according to the user control or the terminal 100 design.

The display unit 140 is configured to provide various screen interfaces required for operating the terminal 100. For example, the display unit 140 supports a standby screen, a menu screen, and the like necessary for operating the terminal 100. The display unit 140 of the present invention may include a touch panel and a display panel. Meanwhile, the display unit 140 may provide various screen interfaces related to the operation of the portrait photography according to the exemplary embodiment of the present invention. Basically, the display unit 140 may provide a screen for activating a portrait photography function, a content playback screen reproduced as a portrait photo, a photo transmission screen for sharing a portrait photo, and a screen for outputting social network record information on the portrait photo. have. The screens provided by the display unit 140 will be described in more detail with reference to the following drawings.

The storage unit 150 may store data or application programs and algorithms corresponding to various basic operating systems and various user functions necessary for operating the terminal 100. In particular, the storage unit 150 supports a portrait photography operation program 155 for supporting a portrait photography operation function, a photo search database 159, a portrait photography database 153 for supporting a portrait photography management function, and a phonebook function. For example, it may include a phone book database 151 including a plurality of phone book information, and a face recognition algorithm 157 for supporting a face recognition function.

The phonebook database 151 may include various phonebook information and social network record information related to the terminal user. Here, the various phone book information may include a phone number of another terminal, email address information, home or company address information, and phone book photo information related to the corresponding terminal user. Here, the phone book photo information is a picture corresponding to the face of the other terminal user, and may be used to check whether or not the face matched in the portrait picture of the present invention. In addition, the phone book information may further include various information such as birthday information, group classification information, memo information input by the user of another terminal user. On the other hand, the phone book information may be stored in association with the record information recorded by the corresponding terminal user while operating the social network 200, for example, Facebook, Twitter, or personal blog. To this end, the phonebook information stored in the phonebook database 151 may include account information used in the social network 200 for collecting Facebook or Twitter upload information of other users. The terminal 100 may access the social network 200 based on account information in real time, at regular intervals, or when a specific event occurs, and collect and store social network record information recorded using the corresponding account information. At this time, the terminal 100 supports to store the social network record information in the corresponding phonebook information. Accordingly, the phonebook information database 151 of the present invention is recorded on the social network by at least one face information of another terminal user, phonebook information of another terminal and the other terminal user and collected by the terminal 100. It may be a database of a type including a. Such a database may support providing the above-mentioned phonebook information and social network recording information in the area or the area around which the recognized face of the portrait photograph matching the face information is automatically or according to user selection.

The picture search database 159 is a database including all pictures stored in the terminal 100. The photo search database 159 may include pictures taken by a user using a camera and pictures received and stored from the outside, for example, animal pictures, plant pictures, landscape pictures, and portrait pictures.

The portrait photo database 153 is a component for storing photographs including faces of various persons. The portrait database 153 may include at least one portrait photograph including one or more faces. The person photo included in the person photo database 153 may be transmitted to another terminal under user control, and may receive a person photo from another terminal. In particular, the person photo stored in the person photo database 153 may be transmitted to other terminals of people included in the picture under user control. The portrait photo database 153 may include only portrait photos including at least one face capable of face recognition among the photos included in the photo search database 159.

The face recognition algorithm 157 recognizes at least one face included in the portrait and connects the phone book database 151 with the recognized face. The face recognition algorithm 157 extracts a feature point of a face included in the portrait picture, checks the phone book information in which the face picture having the extracted feature point is registered in the phone book database 151, and checks the portrait picture and the phone book database ( 151) to connect.

The portrait photography management program 155 is loaded in the controller 160 to support the portrait photography management function of the present invention. The portrait photography operation program 155 is a routine for calling the face recognition algorithm 157 for face recognition of the selected portrait photos when a specific portrait photo is selected in the portrait photography operation mode, according to the operation of the face recognition algorithm 157. And a routine for comparing the phonebook information matching the face in the phonebook database 151. The portrait photography operation program 155 records a social network registered in the social network 200 based on a routine for transmitting the portrait photo to other terminals corresponding to the phonebook information and information registered in the phonebook information according to an input signal. It may include a routine for collecting information, a routine for outputting the collected social network record information on a portrait, and a routine for supporting the operation of a social network function based on a platform for outputting the corresponding social network record information. In addition, the portrait photography operating program 155 may include a routine for classifying the faces detected in the portrait in a single or a combination, a routine for configuring the classified faces or a combination of the faces in a predetermined size, and a screen of a predetermined size. These may include routines for creating new content by combining them.

The controller 160 is a component for controlling various signal transmission, data processing, information collection and output for supporting a portrait photography operation function according to an exemplary embodiment of the present invention. For this, the controller 160 may include a configuration as shown in FIG.

2 is a detailed block diagram of a controller 160 according to an embodiment of the present invention.

Referring to FIG. 2, the controller 160 of the present invention may include a configuration of a face recognition performing unit 161, a social information supporting unit 163, and a group information managing unit 165.

The face recognition performing unit 161 calls the face recognition algorithm 157 stored in the storage unit 150 when an input signal for activating the portrait photography operation function of the present invention is generated. The face recognition performing unit 161 may recognize at least one face included in the corresponding person picture when a specific person picture selection signal is generated from the input unit 120 and the display unit 140 of the input function. The face recognition performing unit 161 may search for phonebook information matching the recognized face and transfer the retrieved phonebook information to the group information operation unit 165. In addition, the face recognition performing unit 161 may transfer the corresponding phonebook information to the social information support unit 163. The phonebook information transmitted here is registered information along with a face picture matching a recognized face. As mentioned above, the phone number of another terminal and the account information such as Twitter or Facebook registered by the other terminal user in the social network 200. It may include email address information of another terminal user.

The social information supporter 163 receiving the phonebook information of the recognized face from the face recognition performing unit 161 may collect account information for accessing the social network 200 from the corresponding phonebook information. The social information support unit 163 may access a social network service device corresponding to the account information, and collect social network record information registered using the account information in the information exchange area of the social network service device. The social information support unit 163 may control to store the collected social network record information together in the phonebook database 151. Meanwhile, the social information support unit 163 may support to output the collected social network record information on the display unit 140 on which the portrait picture is output. In this process, the social information support unit 163 may output the most recently recorded information from the collected social network record information on the portrait as it is. In this case, the social information support unit 163 may support the output of information as it is based on the output window supported by the terminal 100.

The group information operation unit 165 supports a photo sharing function and a group tagging function based on the face recognition portrait. To this end, the group information operating unit 165 may include a photo sharing support unit 61 and a group tagging support unit 63.

The photo sharing support unit 61 receives phonebook information from the face recognition performing unit 161 and collects a phone number or an email address of another terminal. In this case, the collected at least one phone number may be phone numbers corresponding to at least one recognized face included in the portrait. When the input signal for the photo sharing function is generated from the input unit 120 and the display unit 140 of the input function, the photo sharing support unit 61 simultaneously transmits the face recognition person photo to other terminals corresponding to the collected telephone numbers. Alternatively, it may be controlled to transmit sequentially. On the other hand, the photo sharing support unit 61 is another communication service device capable of delivering a portrait picture in addition to the phone number of the other terminal in the phone book information, for example, a social network service device supporting Twitter or Facebook service, or a communication supporting email service. The account information of the service device may be collected. The photo sharing support unit 61 may support a portrait photo sharing function based on the corresponding account information.

The group tagging support unit 63 may receive social network record information registered in the social network 200 in real time through the social information support unit 163, and output the received social network record information in association with each of the recognized faces. have. For example, the group tagging support unit 63 outputs social network recording information corresponding to each face on the remaining areas except for each face area, but instructs each face through a speech bubble, an arrow, a leader line, and the like. It can support to print network record information.

Meanwhile, the group tagging support unit 63 may recognize each face included in the portrait photograph independently or separately by a predetermined group, and control the face recognition to be configured as a separate screen. The group tagging support unit 63 may generate new content by combining separate screens divided based on the recognition faces according to preset information. For example, the group tagging support unit 63 may generate content for outputting separate screens according to a slide method at predetermined time intervals. In addition, the group tagging support unit 63 may update the location information of the person photographed, the shooting time information of the person photograph, the tag information recorded in the person photograph, and the social network record information of each person included in the person photograph. It may be controlled to be included in the generated content and may be supported to output the above-described information to a predetermined area of the screen during the content output process.

As described above, the terminal 100 supporting the portrait photography according to an embodiment of the present invention recognizes the face of the portrait and collects phonebook information corresponding to the recognized face to facilitate various portrait photography operations. To help. In particular, the terminal 100 of the present invention can support to easily and easily create a new content based on the function of collecting and outputting the record information of the person included in the person picture or sharing the person picture or the person picture.

3 is a diagram illustrating an example of a screen interface for supporting portrait photography according to a first embodiment of the present invention.

Referring to FIG. 3, the terminal 100 of the present invention may provide a menu item, a widget, or a hot key supporting photo search. When the user generates an input signal for selecting a corresponding item for executing a photo search, the terminal 100 may output a photo search screen as shown on a screen 301. In this case, the output picture search screen may be a screen for searching for all pictures stored in the storage unit 150 of the terminal 100. For example, the screen 301 may provide a photo search screen including a landscape photo without a person or a natural landscape photo such as sunrise or sunset. In addition, the picture search screen may output a virtual key button 141 for calling the portrait picture operation function to one side of the screen in order to support the portrait photography operation function of the present invention. Alternatively, a button that supports portrait photography can be output to the indicator area.

On the other hand, when the user selects the virtual key button 141, the terminal 100 may output a portrait picture operation screen that can search only the pictures including the person in the picture as shown on the screen 303. To this end, the terminal 100 may control to filter only the whole pictures on the picture search screen to collect only pictures including at least one person. In particular, the terminal 100 may filter only a picture including a portrait picture capable of face recognition among all pictures, and output a portrait picture operation screen based on the picture. For example, even in portrait photography, if the face of the person is not large enough to perform the recognition, the feature point extraction is impossible, or the face is masked so that the face recognition is impossible, and the predetermined number of feature points determined by the face recognition algorithm 157 are determined. The terminal 100 may control to exclude from the photographs for the portrait photography operation function a portrait photograph when it is impossible to extract or when the feature point of the face is not properly included in the photograph region such that it cannot be recognized. As a result, the database for supporting the portrait photography operation function displayed on the screen 303 may be composed of only portrait photos capable of face recognition. To this end, the controller 160 of the terminal 100 may control to generate and store the portrait photo database 153 by filtering only the portrait photos in the photo search database.

Meanwhile, when the user selects a specific family picture 143 of a specific category, for example, a family category, on the screen 303, the controller 160 may perform face recognition on the persons included in the corresponding family picture 143. . For example, when a family picture 143 including a mom, a dad, and a baby is selected, the controller 160 performs face recognition on each person, and the recognized faces 41, 42, and 43 are applied to the recognized faces 41, 42, and 43. Information on the tag and tag information attached to the corresponding family picture 143 may be collected. In addition, the controller 160 may generate a plurality of screens including at least one of the recognized faces 41, 42, and 43. In more detail, the controller 160 automatically recognizes an area in which all of the faces 41, 42, and 43 including the mother, the father, and the baby are commonly recognized as in step 305. The controller 160 automatically recognizes an area in which the first face 41 is mainly recognized among the entire faces 41, 42, and 43, and collects the screen according to the screen 307. In addition, the controller 160 automatically recognizes an area where the second face 42 is mainly recognized as shown in screen 309 and collects a screen according thereto, and displays an area where the third face 43 is mainly recognized as in screen 311. Automatically recognize and collect the screen accordingly. In addition, the controller 160 zooms out the screen to have a minimum face size capable of face recognition as in step 313 and collects the screen accordingly.

Thereafter, the controller 160 may arrange the collected screens in a predefined manner to automatically generate one new content, for example, content in which the above-described screens 305 to 313 are sequentially displayed at a predetermined time interval. have. Meanwhile, in the above description, the screen collection for each face recognition is described as an example for automatically generating contents, but the present invention is not limited thereto. That is, the controller 160 includes all of the first to third faces 41, 42, and 43 with respect to the first family picture 143, and enlarges it by a predetermined ratio based on the faces 41, 42, and 43. Or information for instructing to reduce, information for instructing to enlarge or reduce by a percentage based on the first face 41, information for instructing to enlarge or reduce by a certain ratio based on the second face 42, and a third face Information indicating to enlarge or reduce by a predetermined ratio based on (43), including all of the first to third faces 41, 42, 43 and a specific ratio based on each of the faces 41, 42, 43. As such, information indicating to zoom out or zoom-in, information on a time schedule for outputting each indication information, etc. may be generated and output based on a slide method, and stored as new content. Thereafter, when the request for playing the corresponding content occurs, the controller 160 supports to enlarge and display the predetermined face area by a predetermined ratio based on the family photo 143 and the new content described above. It can support output in a slide way.

4 is a diagram illustrating screens for explaining a photo sharing function among the portrait photography operating function according to the second embodiment of the present invention.

Referring to FIG. 4, when an input signal for activating the portrait photography operation function is generated on the photo search function or an input signal for activating the portrait photography operation function on a standby screen or in a specific function state, the terminal 100 receives 401. As shown in the screen, a portrait picture may be output to the display unit 140. In this case, the terminal 100 may output a specific photo including the faces of a plurality of people to the display unit 140 according to a user selection.

The controller 160 of the terminal 100 may control to perform face recognition with respect to faces included in the selected portrait picture when a specific portrait picture is selected while the portrait photography operation function is activated. In addition, the controller 160 may search the phone book database 151 for the phone book information registered as a face picture that matches the recognized faces. Herein, the controller 160 may collect a phone number or an email address of another terminal from the retrieved phone book information.

Thereafter, when an input signal for performing a sharing function for the selected portrait photograph is generated, the controller 160 may control to transmit the corresponding portrait photograph to another terminal based on the collected telephone numbers of other terminals. To this end, the terminal 100 may output a menu item for performing a portrait photo sharing function to one side of the screen. In particular, the terminal 100 may output a specific virtual key button for performing a photo sharing function on the portrait photography operation function screen. Alternatively, the terminal 100 may assign a specific key included in the input unit 120 as a hot key for performing a photo sharing function. Alternatively, the terminal 100 may provide a link for performing a portrait photo sharing function to a graphic element displayed on the recognized face. Accordingly, when an input signal for selecting a recognized face is generated, the terminal 100 may support to automatically perform a portrait photo sharing function.

In the screen 401, four faces are recognized. Accordingly, when the user requests to perform a photo sharing function, the controller 160 may transmit the corresponding person photo to other terminals based on phonebook information corresponding to four faces. As a result, the terminal 100 transmits the portrait picture to three other terminals as shown on the screens 403, 405, and 407. Here, one of four portraits assumes a situation corresponding to a user outputting a 401 screen to the display unit 140. When the terminal 100 checks the face photo information of the user and confirms that the face photo is registered as the face of the terminal user, the terminal 100 may omit collection of phone book information corresponding to the face and transfer of the portrait photo. To this end, the terminal user may register his face picture when writing terminal information.

Meanwhile, the controller 160 may output an alarm for a face not registered in the phonebook information while performing face recognition on the portrait picture. Then, the controller 160 may output a message, an indicator, or a graphic effect indicating that the face is not registered in the phonebook information. For example, when a search for information matching the face picture 410 fails on the screen 401, the controller 160 may output a message or a graphic effect about the information search failure on the face picture 410. In addition, the controller 160 may further perform a process for checking whether the face picture 410 is a face picture registered in the terminal user's own information. If the face picture 410 is the face of the terminal user, no separate display may be performed. If a separate face picture is not registered on the face of the terminal user, the controller 160 may support to perform the same display as the display of the unregistered face picture in the phonebook information.

Thereafter, when the user selects the face picture 410 of the user, the controller 160 may provide a screen interface for registering the face picture 410 in the phone book information or as a face picture of the terminal user. In particular, when the face photograph of the terminal user is already registered, the controller 160 presents a screen for registering phonebook information. If the face photograph of the terminal user is not already registered, the controller 160 may output a pop-up window for selecting one of the phonebook information registration screen and the terminal user face photo registration screen output. The controller 160 may select at least one of a phone book search item, a photo registration support item, and a new item for generating phone book information when the item for the phone book information registration screen is selected, the corresponding face picture registration may be performed for specific phone book information. It may support to output a screen including a.

Meanwhile, when the terminal 100 receives the above-described portrait picture from another terminal, the controller 160 may store the received portrait picture in the photo search database 159. In this case, the controller 160 may control to automatically classify and store the corresponding person picture into a specific category based on the category information classified by another terminal of the transmitted person picture. For example, if the transmitted person photo has a history classified into a "friend" category in another terminal and includes the history information, the controller 160 may classify the person photo into the "friend" category and store it. In this case, when there is no "friend" category in the photo search database 159, the controller 160 may classify the received portrait photo with the category generation or classify the received portrait photo in other categories. Alternatively, the controller 160 may control to automatically classify and store in a category having a name most similar to the category name.

In this process, the controller 160 may process the user to confirm that the received portrait picture is to be classified into a specific category, and provide the above-described categories in a selectable list form, and receive the person in the category selected by the user. You can help save your photos. In this case, the controller 160 may provide a different list according to the previous category name of the received portrait when the selectable category list is provided. That is, when the received portrait photo is classified as "family" by the previous category name, the selectable category list may include a list including at least one category item, other items, and the like, including at least a part of the word "family". Can be. In order to support such a function, the terminal 100 for storing a specific picture may support writing a category name in which each picture is stored as a tag of the corresponding picture. Then, various types of pictures stored in the picture search database 159 may include category names for classification. Accordingly, the specific person photo stored in the photo search database 159 may be transmitted and received with other terminals including the category name like other pictures, and may be automatically classified or recommended based on the corresponding category information.

On the other hand, in the above description has been described an example of using a phone number of another terminal for sharing a picture, the present invention is not limited thereto. That is, the controller 160 of the terminal 100 checks information related to phonebook information, call logs, and the like, and selects one of the most recently used communication service items or the most used communication service items by other users corresponding to the recognized faces. One can perform portrait photo transfer. For example, if the communication service used by another user of a specific face among the recognized faces is a chat service, the controller 160 may support to transmit the corresponding person picture through the chat service. To this end, the controller 160 may automatically activate a chat program and upload a portrait picture through a chat window with the corresponding user.

In addition, when the communication service most frequently used with other users of a specific face is text, the controller 160 may control to transmit a portrait picture using a text service, in particular, a multimedia message service. In addition, when the communication service most recently used by another user of a specific face is a case in which social network recording information is written on Twitter, the controller 160 may control to register a portrait photograph on the corresponding social network service device. According to a user setting of the controller 160 or by default, a person's picture may be transmitted based on one of a communication service item most recently used or a communication service item most used among each other.

Meanwhile, the picture sharing function may be equally applied to content produced by the group tagging function described above. That is, the controller 160 may support transmission to a communication service device used by people included in the newly produced content when an input signal for activating the photo sharing function of the newly produced content is generated by the group tagging function.

In addition, the photo sharing function automatically performs the above-described steps to transmit to the communication service device used by other users when receiving an input signal for activating group transmission of the currently searching portrait photo while performing the portrait photo operation function for easy group transmission. Can support Herein, the controller 160 may transmit a picture using a plurality of communication service apparatuses or a plurality of communication service schemes according to a user setting. For example, the controller 160 may control to transmit a picture through all of a message service method, a chat service method, and a social network service method.

In addition, the photo sharing function may be automatically performed in association with a specific user function of the terminal 100. For example, the terminal 100 includes a camera, and when the user takes a portrait picture including a plurality of faces by using the camera, a person photographed by a communication service device associated with another user corresponding to the faces. You can support sending photos automatically. In this case, the terminal 100 may control to perform a confirmation process for confirming this before transmitting the portrait group.

FIG. 5 is a diagram illustrating an example of a screen interface for supporting social information in a portrait photography operation function according to a third embodiment of the present invention.

Referring to FIG. 5, the terminal 100 according to an embodiment of the present disclosure may provide a screen for searching for a specific portrait picture among various portrait pictures as shown on a screen 501. To this end, as described above, the terminal 100 may output a search screen based on the photo search database 159 or a search screen based on the portrait photo database 153 configured to include only portraits of the photo search database 159. have. Here, the search screen based on the 501 screen portrait photo database 153 is displayed. To this end, the user may generate an input signal for activating the portrait photography operating function based on the portrait photography database 153. Meanwhile, the user may search for other portraits by using a flick event or a drag event on the screen 501.

In particular, the user may request activation of a function for supporting social information of the present invention. To this end, the terminal 100 may output a menu item for selecting a social information support function as one of the portrait photography operation functions to one side of the portrait photography operation screen or assign it to a specific key of the input unit 120. In addition, the terminal 100 may include command information for operating the social information support function in the graphic element displayed on the recognized face. Accordingly, when an input signal for selecting a specific face is generated, the terminal 100 may perform a social information support function of another user corresponding to the selected specific face. That is, when the corresponding input signal is generated, the controller 160 of the terminal 100 may support to output the portrait picture to which the social information support function is applied to the display unit 140 as shown on the screen 503.

In more detail, when the input signal for activating the social information support function is generated, the controller 160 performs face recognition for faces included in the portrait. In addition, the controller 160 may search for phonebook information in which a face picture corresponding to the recognized face is registered. Thereafter, the controller 160 may output the social network record information registered in the corresponding phonebook information to a specific position of the portrait. For example, the controller 160 may output the social network recording information to a location associated with specific faces of the portrait. To this end, the control unit 160 collects the account information of other terminal users registered in the phone book information, the social network 200 when real-time or at regular intervals, or when the portrait photography operation function of the present invention is activated based on the collected account information. Can access the social network record information listed as the account information. Herein, the controller 160 may request the account information used in the social network 200 from the other terminal based on the phone number of the other terminal registered in the phone book information. Alternatively, the controller 160 may operate account information directly input by a user or collect account information associated with a phone number by accessing the social network 200 and using the phone number. In this case, the controller 160 may store the collected social network record information in association with the phonebook information, but may store the collected social network record information in chronological order, and store only a predetermined number in consideration of the storage space.

On the other hand, if the social network record information is already stored in association with the phone book information or collected the social network record information collected from the social network 200 when the portrait photography operation function of the present invention is activated, the controller 160 displays a screen 503. As shown in FIG. 1, the social network record information may be output to a portrait picture of at least one social network record information collected based on a recent time point. At this time, the control unit 160 outputs the social network recording information on a schedule output window provided by the terminal 100, and performs processing or filtering of the recording information or outputs the recording information area 510 without any additional processing or filtering. can do.

The record information area 510 includes name information of a person corresponding to a recognized face, social network record information, type information of the collected social network 200, and corresponding social network record information written on the social network 200. It may include viewpoint information. In addition, the recording information area 510 may output communication service connection items 511 including items capable of directly performing a message, an email, a chat, or an SNS connection to the person. In this case, the communication service connection items 511 may include items that can be actually connected to the corresponding person's picture. For example, if the person does not have an email account, the email item may be omitted from the communication service connection items 511. In addition, when the person uses only social network services other than Facebook, for example, Twitter, Twitter items may be output on communication service connection items 511 instead of Facebook items.

On the other hand, the screen 503 is shown to output only the social network record information of a specific person, but the present invention is not limited thereto. That is, the controller 160 of the terminal 100 may output the social network recording information for each of the plurality of people included in the portrait picture as shown on the screen 505. In this case, the controller 160 outputs the social network record information while maintaining the shape of the portrait photograph according to the amount or size of the social network record information, or displays the social network record information based on the recognized faces as shown on the screen 507. You can perform screen rearrangement. That is, the controller 160 may extract the recognized faces and support rearranging and displaying social network record information in a list form based on the extracted faces. Herein, when an input signal for returning to the screen 505 is generated, the controller 160 may control to display only some of the social network recording information. Alternatively, the controller 160 may support the user to select one of the display modes of the 505 screen and the 507 screen.

As described above, the system and the screen interface for supporting the portrait photography according to the embodiment of the present invention are a simple new content generation function for the portrait photo stored in the storage 150 or collected through the camera, the portrait photo or It may provide a function of sharing new content generated by a person photo and a function of sharing information with people included in the person photo. Accordingly, the terminal user can operate various terminal functions more easily and adaptively through the portrait picture search screen.

6 is a view for explaining a portrait photography operating method according to an embodiment of the present invention.

Referring to FIG. 6, in the portrait photography operating method of the present invention, when power is supplied in step 601, the controller 160 delivers the supplied power to each component of the terminal 100 to perform user function operation of the terminal. Can be controlled. When an input signal is generated from the input unit 120 and the display unit 140 of the input function, the controller 160 determines whether the input signal is an input signal for activating the portrait photography operation function in step 603. In this step, if the input signal is not an input signal for the portrait photography operation, the process branches to step 605 to support the terminal function according to the input signal. For example, the controller 160 may perform a file play function, a broadcast reception function, a file search function, a web access function, a message writing function, a memo function, etc. according to the input signal and whether the terminal 100 supports the function. Can be controlled.

Meanwhile, when the input signal generated in step 603 is an input signal for activating the portrait photography operation function of the present invention, the controller 160 may control to output the portrait photography operation screen according to the corresponding input signal to the display unit 140. To this end, the controller 160 may configure the portrait photo database 153 by filtering the portrait photographs in the photo search database 159 stored in the storage 150 in step 607 and store them in the storage 150. In this case, if there is a history of operating the portrait photography function, the controller 160 may control to operate the portrait photography operation function based on the previously generated portrait photo database 153.

In operation 609, the controller 160 may output the portrait photography operation function screen to the display 140 based on the portrait photo database 153 stored in the storage 150. That is, the controller 160 may support the display unit 140 to output a search screen for searching for a portrait picture including at least one face. Here, the portrait photos included in the portrait database 153 may be photographs including at least one face capable of face recognition as described above. Accordingly, even in the case of a portrait picture including various faces, the picture may be excluded from the portrait picture database 153 when the face recognition is impossible. In this case, the photo that cannot be recognized may vary according to a face recognition algorithm designed to recognize a face. That is, when the face recognition algorithm extracts a certain number of facial feature points and is designed to recognize a face based on the number of facial feature points, a face recognition capable portrait may be a picture that can extract a certain number of facial feature points. The above-described facial feature point extraction may be a photograph.

In operation 611, the controller 160 may control to perform face recognition on the person photo currently output to the display unit 140. In practice, this step may be omitted since the face recognition is performed to confirm whether there is an area where a face is available in a specific picture in the process of constructing the portrait picture database 153. However, in the process of constructing the portrait photo database 153, if only a specific photograph is designed to check whether there is a face region capable of face recognition, it is necessary to perform a more detailed face recognition function to support the portrait photography operation function of the present invention. .

Next, the controller 160 may display a display of the face recognized in operation 613 on the corresponding portrait picture. For example, as illustrated in FIG. 4, the dotted lines may be provided to the recognized faces to display the recognized faces.

In addition, the controller 160 may support to output items for performing the portrait photography operation function to one side of the screen. That is, the controller 160 may support to output an item capable of operating at least one of a photo sharing function, a group tagging function, and a social information function on the portrait photography operation screen in step 615.

Next, the controller 160 may determine whether a specific item is selected from the above-described items in step 617, and may support to perform the portrait photography operation function according to the selected item in step 619 when the specific item is selected. That is, the controller 160 generates new content based on the recognized faces when the group tagging function is selected, and the communication service device of another user corresponding to at least one face of the portrait photo included in the selected photo when the photo sharing function is selected. Control to send the person photo alone or to a group. In addition, when selecting a social information function, the controller 160 may support to collect social network record information recorded in a social network service device used by at least one other user corresponding to the recognized face and output the recorded social network information on the corresponding portrait picture.

Next, the controller 160 checks whether an input signal for terminating the portrait photography operation function is generated in step 621, and if there is no separate function end input, branches to step 603 to support re-execution in the following process. . If a function termination input signal occurs, the controller 160 supports termination of the function.

On the other hand, in the description of the method for operating a portrait photography of the present invention has been described as performing the above-described portrait photography operation based on the portrait photo stored in the storage unit 150, the portrait photography operating method of the present invention is collected through a camera For the portrait picture, any one of the above-described face recognition, a photo sharing function, a group tagging function, and a social information support function may be supported according to an input signal.

In addition, in the above description, when the portrait photograph is displayed on the display unit, a graphic element for displaying a recognized face through the face recognition may be provided or specific items are provided, but the present invention is not limited thereto. That is, the present invention automatically performs at least one of the new content providing function, the portrait picture sharing function, and the social network record information output function provided based on the recognized face of the portrait picture when the portrait picture is output based on the portrait picture database. Can be. Accordingly, the terminal and the operation method of the present invention are based on the new content and the specific portrait picture provided based on the specific portrait picture according to the automatic execution of at least one of the above-described functions when searching for the portrait picture according to preset schedule information or user setting. At least one of the social network record information may be supported through the display unit. In the portrait photo sharing function, the terminal and the method of the present invention search for a specific portrait photo based on a photo search database and generate an input signal for activating the portrait photo operating function of the present invention. It is possible to support the extraction of the phone book information corresponding to the faces that can be recognized in the automatic photo sharing function based on it.

On the other hand, the terminal and the operating method of the present invention, if it is not set to automatically perform a specific user function associated with the recognized face, as described above, the graphic element for selecting the recognized face for manual operation of the specific user function and The display unit may be configured to display at least one of the separate display items that support the specific user function. Then, the user may operate at least one of the above-described new content generation function, portrait photo sharing function, and social network record information display function by selecting the corresponding graphic element or selecting the corresponding display item.

Meanwhile, the terminal 100 may further include various additional modules according to the providing mode. That is, the terminal 100 is a communication terminal, a short-range communication module for short-range communication, an interface for data transmission / reception by a wired communication method or a wireless communication method of the terminal 100, An Internet communication module, and a digital broadcasting module that performs digital broadcasting reception and reproduction functions. These components can not be enumerated because of a wide variety of variations depending on the convergence trend of the digital device, but it is also possible that components having the same level as the above-mentioned components are further included in the device have. Also, it is needless to say that the terminal 100 of the present invention may be excluded from the specific configurations in the above configuration or may be replaced with other configurations in accordance with the provision mode thereof. Which will be readily apparent to those skilled in the art.

In addition, the terminal 100 according to an embodiment of the present invention, including all the mobile communication terminals (mobile communication terminals) that operate based on communication protocols (communication protocols) corresponding to various communication systems (Portable Multimedia) Players, digital broadcasting players, PDAs (Personal Digital Assistants), music players (e.g. MP3 players), mobile game terminals, smart phones, notebooks and handheld PCs It may include an application device therefor.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. , And are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be practiced without departing from the scope of the invention disclosed herein.

100: terminal 110:
120: input unit 130: audio processing unit
140: Display unit 150:
160:

Claims (20)

Outputting at least one portrait picture to a display in response to a user input;
Recognizing at least one face included in the output portrait photo;
Comparing the recognized at least one face with a database including at least one face information, phonebook information, and collected social network record information;
A graphic element for automatically performing a specific user function related to the recognized at least one face or selecting the recognized face for manual operation of the specific user function with reference to a comparison result with the database; Displaying at least one of separate display items that support a specific user function. The method of claim 1,
The method may further include configuring portrait pictures including at least one face capable of face recognition among separate pictures stored in the terminal as a separate portrait picture database.
The process of outputting the portrait picture to the display unit
And outputting at least one portrait picture to the display unit by referring to the portrait photo database when at least one specific portrait picture display request is made. The method of claim 1,
And performing the specific user function according to the selection of one of the graphic element and the display item.
The above process
A portrait photo sharing process of transmitting the portrait photo to another user terminal based on phone book information matching the recognized faces;
Generating a new content by arranging a plurality of screens including at least one of the recognized faces in a preset manner;
Collecting the social network account information of the user matching the recognized faces, collecting the social network record information recorded by the user on the social network based on the social network account information, and providing the information on the screen on which the portrait photo is output; Social information support process; A portrait photography operating method comprising the at least one process. The method of claim 3,
When there is an unregistered face among the faces included in the portrait picture, an item that can be selected for registering an unregistered face as one of the face picture of the terminal user and the new phone book information is displayed, and the item included in the portrait picture according to the item selection is displayed. Outputting any one of a screen for registering an unregistered face as a face picture of a terminal user and a screen for registering with new phonebook information when there is an unregistered face among the faces;
Outputting a screen for registering as new phone book information when there is an unregistered face among the faces included in the portrait picture and there is a picture registered as the face picture of the terminal user; The portrait photography operating method further comprising any one of the process. The method of claim 3,
The portrait photo sharing process
Based on one of the communication service item most recently used by another user and the communication service item most used by another user corresponding to the face included in the portrait picture,
And transmitting a photo through at least one communication service method capable of delivering the portrait photo to another user corresponding to the face included in the portrait photo. The method of claim 3,
Activating the camera;
Photographing a portrait including a plurality of recognizable faces using the camera;
The portrait photo sharing process
Automatically performing face recognition along with the portrait photography, and automatically transmitting the portrait photo to a communication service device used by another user corresponding to the face based on phonebook information corresponding to the recognized face. Portrait photography operation. The method of claim 3,
The social information support process
Maintaining and displaying the original of the social network record information recorded on the social network or displaying at least a part of the social network record information;
Displaying items capable of connecting a communication service with a communication service device used by another user corresponding to a recognized face when outputting the social network record information on the portrait picture;
Displaying at least a part of the entire social network record information and outputting the social network record information while maintaining a form of a portrait picture;
Extracting the recognized faces and rearranging and displaying social network record information in a list form based on the extracted faces; A portrait photography operating method comprising the at least one process. The method of claim 3,
The social information support process
Collecting social network account information of a user that matches the recognized faces;
Collecting social network record information recorded by a corresponding user on a social network based on the collected social network account information when a predetermined period or real time or a request for outputting social network record information is requested;
Storing the social network record information in association with phonebook information including the social network account information;
And outputting the social network record information by checking the phonebook information when outputting the social network record information. The method of claim 3,
The new content creation process
Generating a plurality of screens including at least one of the recognized faces and arranging the generated screens in a slide manner at predetermined time intervals;
Collect enlargement or reduction ratio information of enlarged or reduced screens including at least one of the recognized faces, and arrange a time point at which the enlargement or reduction ratio is applied at predetermined time intervals to display a portrait picture at each time interval. Displaying the enlarged or reduced screen in a slide manner; Portrait photograph operating method comprising the process of any one of. 3. The method of claim 2,
Receiving a portrait picture from the outside;
Checking category information of the received portrait photo;
And classifying and storing the portrait photograph in a specific category preset in a storage unit based on the category information. A display unit configured to output at least one portrait picture in response to a user input;
Recognizing at least one face included in the output portrait photo, and comparing the recognized at least one face with a database including at least one face information, phonebook information and collected social network record information. Automatically performing a specific user function related to the recognized at least one face or graphic element for selecting the recognized face for manual operation of the specific user function and supporting the specific user function And a control unit for controlling to display at least one of the separate display items. 12. The method of claim 11,
And a storage unit configured to store a separate portrait picture database of portrait pictures including at least one face capable of face recognition among pictures stored in the terminal.
The display unit
And at least one portrait photo with reference to the portrait photo database upon request of displaying at least one specific portrait photo. 12. The method of claim 11,
The control unit
A portrait photo sharing function of transmitting the portrait photo to another user terminal based on phone book information matching the recognized faces according to selection of one of the graphic element and the display item;
A new content generation function for generating new content by arranging a plurality of screens including at least one of the recognized faces according to a preset method;
Collect social network account information of the user that matches the recognized faces, collect social network record information recorded by the user on the social network based on the social network account information, and provide it on the screen where the portrait is output. Supporting social information support function; A terminal for supporting portrait photography, characterized in that for controlling the support of at least one function. The method of claim 13,
The control unit
If there is an unregistered face among the faces included in the portrait picture, the user is controlled to display an item that can be selected to register the unregistered face as one of the face picture of the terminal user and the new phonebook information, If there is an unregistered face among the included faces, a screen for registering an unregistered face as a face picture of the terminal user and a screen for registering with new phonebook information are controlled to be output.
If there is an unregistered face among the faces included in the portrait picture and there is a picture registered as the face picture of the terminal user, the terminal for supporting the operation of the portrait picture, characterized in that for controlling to output a screen for registering as new phonebook information. The method of claim 13,
The control unit
When the portrait photo sharing function is supported, the user may transmit based on one of a communication service item most recently used with another user corresponding to a face included in the portrait picture or a communication service item most used with another user.
And controlling to transmit a picture through at least one communication service method capable of delivering a portrait picture to another user corresponding to a face included in the portrait picture. The method of claim 13,
A camera for taking a portrait picture comprising a plurality of recognizable faces; further comprising,
The control unit
Automatically perform face recognition along with the portrait photography, and control to automatically transmit the portrait photo to a communication service device used by another user corresponding to the face based on phonebook information corresponding to the recognized face. Terminal that supports portrait photography operation. The method of claim 13,
The display unit
When the social information support function is operated, maintaining and displaying an original of the social network record information recorded on the social network or at least a part of the social network record information;
Items capable of connecting a communication service with a communication service device used by another user corresponding to a recognized face when outputting the social network record information on the portrait picture;
At least a part of all of the social network recording information displayed while maintaining the shape of the portrait photograph when the social information supporting function is operated;
An ordered list of at least one recognized face extracted from the portrait photograph and social network record information collected in association with the recognized faces when the social information supporting function is operated; And at least one terminal for supporting portrait photography operation. The method of claim 13,
The storage unit
User's social network account information collected in match with the recognized faces;
Social network record information collected from a social network based on the social network account information when a predetermined period or real time or a request for outputting the social network record information is output based on the social network account information;
Stores phonebook information stored in association with the social network record information;
The display unit
And outputting the stored social network record information in association with phonebook information when the social network record information display request is displayed. The method of claim 13,
The control unit
When the new content generation function is operated, a plurality of screens including at least one of the recognized faces are generated, and the generated screens are arranged to be displayed in a slide manner at a predetermined time interval, or
Collect enlargement or reduction ratio information of enlarged or reduced screens including at least one of the recognized faces, and arrange a time point at which the enlargement or reduction ratio is applied at predetermined time intervals to display a portrait picture at each time interval. A terminal that supports portrait photography, characterized in that designed to display an enlarged or reduced screen in a slide manner. The method of claim 12,
Further comprising; a communication unit for receiving a portrait picture from the outside,
The control unit
And checking category information of the received portrait photo, and controlling to classify and store the portrait photo in a specific category preset in a storage unit based on the category information.

Images