KR101534808B1 - Method and System for managing Electronic Album using the Facial Recognition - Google Patents

Abstract

Provided are a method and system for managing an electronic album using a face recognition technology. The method for managing an electronic album using a face recognition technology proposed in the present invention comprises: a step of analyzing multiple images saved in a terminal to recognize a face of a certain object; a step of assigning a tag to the recognized face; and a step of grouping the images including the certain object using the tag. The method for managing an electronic album using a face recognition technology comprises additionally a step of filming, which may include a step of displaying face recognition marks on the object′s face in a filming mode; a step of displaying registration information matched with the face if a tag has been assigned to the face; and a step of adding the face to the group of images including the face if a tag has been assigned to the face.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic album management method and system using face recognition technology,

The present invention relates to a method and apparatus for managing data in electronic albums and for sharing such data.

In recent years, digital image generation and dissemination have become easier due to the popularization of portable digital cameras and terminals equipped with cameras, and the accuracy of the face recognition technology is improved as the correction and analysis techniques for digital images are developed.

Face recognition is a security measure that can be used safely without fear of theft, loss, forgetting, etc. It is not only a sensor manufactured separately such as iris, fingerprint, etc., but is easily available using a camera already installed Most ID cards have photo data, so it is easy to use large amounts of data.

In addition, the face is a means by which a person can identify a person, so that a manager can check the result later and is not a contact type, so it can be easily applied as a monitoring means in a large public facility.

Face recognition first extracts facial regions using edge, color, and geometric relationships of facial components (eyes, nose, mouth), and extracts feature vectors that can distinguish subtle differences between different people.

The construction of a large-capacity face database considering various environmental changes in face recognition is essential for improving and evaluating the performance of the face recognition system, and consideration should be given to the presence of color and direction of illumination, various facial expressions, various angles and accessories.

Face recognition technology can be applied to access control with face recognition technology without needing access control of offices, houses, etc., passwords that are concerned about forgetting, keys with the fear of theft or loss, and identification cards. And smart card security levels, as well as providing personal authentication solutions for ATM and Internet banking.

In addition, personal authentication and e-commerce through mobile communication devices such as mobile phones and PDAs as well as PC and server security solutions in enterprise networks, remote personal authentication for electronic banking and e-learning using mobile communication are possible.

In such face recognition, there is a wide range of applications such as an auto focus function that focuses on the face at the time of shooting, a function of authenticating a person by comparing photographs, and a function of automatically characterizing features of a person. It is used to control access control and criminals in areas where security is required.

Recently, a function of adding a face recognition function to a digital camera or a terminal with a camera is provided. In the electronic album of the existing terminal camera, the image can be rearranged through the location-based or time-based data. However, there is no support for face based recognition through face recognition, and there is no automatic sharing service based on face recognition.

SUMMARY OF THE INVENTION The present invention provides a method and system for grouping images in electronic albums through facial-based data and automatically sharing them on the basis of face recognition.

According to an aspect of the present invention, there is provided an electronic album management method using a face recognition technology, which includes analyzing a plurality of images stored in a terminal and recognizing a face of a specific object included in the images, And a step of grouping the images including the specific object using the tag.

The step of recognizing a face of a specific object included in the images may automatically recognize a face of a specific object included in at least a predetermined number of images among the images.

The step of assigning the tag to the recognized face may ask the user whether or not to assign a tag to the face, and may match the registration information corresponding to the face when the user allows the tag.

The step of assigning the tag to the recognized face may include a step of registering the face of the object to be automatically shared among the images taken in the photographing mode in advance.

The step of grouping images including the specific object using the tag may include managing the grouped image in synchronization with account information of various SNS platforms such as a user's contact, Facebook, and LinkedIn .

The electronic album management method using the face recognition technology may further include photographing, wherein the photographing includes displaying a face recognition mark on a face of a subject to be photographed in a photographing mode, Displaying registration information matched to the face, and adding the tag to the group of images including the face if the face is previously tagged after the photographing.

In the photographing mode, the step of displaying the face recognition indication on the face of the photographing object can be distinguished and displayed according to whether tags are assigned in advance to the face.

And automatically sharing the photographed image with the subject when the face of the subject photographed in the photographing mode is a face registered with the automatic sharing function.

According to another aspect of the present invention, an electronic album management system using the face recognition technology proposed in the present invention allocates a tag to a face of a specific object included in a plurality of images stored in a terminal and controls to group the images A storage unit for storing the tag and registration information by matching the registration information corresponding to the face allocated with the tag, and a storage unit for storing the tag and registration information when the tag is allocated to the face, And a communication unit for automatically transmitting the automatic sharing to the registered object.

The control unit may control to register the face of the object to be automatically shared in advance when assigning a tag to the face of the specific object. If a tag is previously assigned to the face photographed in the photographing mode, Can be controlled so that the registered information is displayed on the display.

Currently, most of the terminal applications through face recognition are mostly fun applications such as face decorating, decorating, and applying face recognition, whereas according to the embodiments of the present invention, You can easily organize, tag, manage images and find images easily. In addition, the application automatically recognizes the object to be photographed and can automatically share the image with the object.

1 is a flowchart illustrating an electronic album management method using a face recognition technology according to an embodiment of the present invention.
2 is a view for explaining a face recognition process according to an embodiment of the present invention.
3 is a diagram for explaining a photographing step according to an embodiment of the present invention.
4 is a diagram illustrating a process of displaying a face recognition display according to an embodiment of the present invention.
FIG. 5 illustrates a process of synchronizing a grouped image with a user's contact according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 6 is a diagram illustrating a configuration of an electronic album management system using a face recognition technology according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart illustrating an electronic album management method using a face recognition technology according to an embodiment of the present invention.

An electronic album management method using face recognition technology includes a step 110 of recognizing a face of a specific object included in images by analyzing a plurality of images stored in the terminal, a step 120 of assigning a tag to the recognized face, , Grouping (130), and photographing (140) images including a specific object using a tag.

In step 110, a plurality of images stored in the terminal may be analyzed to recognize a face of a specific object included in the images. A plurality of images may be stored in the electronic album of the terminal. The plurality of images may be pictures or videos and the like. The face included in these images can be recognized. For example, the face recognition method extracts facial regions using edge, color, and geometric relationships of facial components (eyes, nose, and mouth), and extracts feature vectors that can distinguish subtle differences between different people . These vectors can be used to distinguish different faces. At this time, a face included in at least a predetermined number of images among the plurality of images can be automatically recognized. For example, if there are three or more pictures containing a specific object, the face of this specific object can be recognized.

In step 120, a tag may be assigned to the recognized face. A face included in at least a predetermined number of images among the plurality of images can be automatically recognized and the tag can be assigned. For example, if there are three or more pictures containing a specific object, the face of this specific object can be recognized and the tag can be assigned. At this time, the user may be asked whether or not to assign a tag to a face of a specific object. When the user allows a tag on a face of a specific object, registration information of a specific object corresponding to the face can be matched. Here, the registration information may include a name of a specific target, a contact such as a telephone number and an e-mail, SNS account information such as Facebook, LinkedIn, and the like. For example, if the particular subject is a 'mother', it can match the related information such as the phone number, email, Facebook profile, etc. of the 'mother'. In addition, the step of assigning the tag to the face may register the face of the object to be automatically shared with the images photographed in the photographing mode in advance. For example, if you assign a tag to the face of "mom", you can register "mom" as an auto-sharing target. Then, when photographing 'mother', the camera recognizes the face of 'mother' and can transmit the image photographed to 'mom' at the same time as photographing.

In step 130, tags may be used to group the images containing a particular object. It is possible to automatically recognize a face included in at least a predetermined number of images among a plurality of images, assign tags, and group the images including the tag-allocated faces. For example, if the face of 'mother' is included in a predetermined number or more of images and a tag is assigned to the face of 'mother', the images including 'mom' can be grouped together. For example, a group name can be a 'mother' or a 'family', which is a collection of pictures of a mother. The 'family' group can then store photos that include the face of 'mom'. In addition, the grouped images can be managed in synchronization with the user's contacts. For example, you can manage your 'mom' image and contacts in the 'family' group in sync. The process of managing the grouped images in synchronization with the user's contacts will be described in detail with reference to FIG.

In step 140, a photographing can be performed. The face recognition display can be displayed on the face of the subject to be photographed in the photographing step (140). When a tag to be photographed is assigned in advance to a tag, registration information matched to the face can be displayed. For example, the property may be a name. Therefore, if a tag is assigned in advance to a face to be photographed, the name matched to the face can be displayed. If such a target is photographed and a tag is previously assigned to the face, the photographed image can be added to the group of images including the face. Will be described in more detail with reference to FIG.

2 is a view for explaining a face recognition process according to an embodiment of the present invention. Referring to FIG. 2A, a plurality of images 210a, 220a... Stored in a terminal are shown. The first image 210a is an image including three subjects 211a, 212a, and 213a. It is assumed that the specific object 211a among the objects included in the first image 210a is included in the plurality of images in addition to the first image 210a. The face of the specific object 211a included in at least a predetermined number of images among the plurality of images 210a, 220a,... Can be automatically recognized and the tag can be allocated. For example, when the predetermined number is 3, if the face of the specific object 211a is included in three or more images, a tag can be assigned to the face of the specific object 211a.

Referring to FIG. 2B, the face recognition display 212b may be displayed when a tag is assigned to a face of the specific object 211a. Then, the user can be asked whether or not to assign a tag to the face of the specific object 211b. When the user allows a tag on a face of a specific object, 'Kim OO' can be tagged when the name of the specific object 211b is 'Kim OO'. Further, registration information of the specific object 211b corresponding to the face can be matched. For example, when the specific object 211b is 'Kim XX', it can be matched with related information such as telephone number, e-mail, SNS account, etc. of 'Kim XX'. In addition, when a tag is assigned to a face, the face to be automatically shared with the images photographed in the photographing mode can be registered in advance. For example, when the specific target 211b is registered as an automatic sharing target, the captured image can be transmitted to the specific target 211b at the same time as the specific target 211b is photographed.

Also, after assigning the tag 'Kim' to the specific object 211b, the images can be grouped using the tag. For example, a specific object 211b may be included in the first image of the specific object 211b, and a specific object 221b may be included in the second image of the specific object 211b. At this time, the specific object 211b and the specific object 221b are the same person. When the number of pictures including the specific object 211b 'Kim' is more than a predetermined number, the plurality of pictures 210b, 220b,... Can be grouped. If 'Kim ○○' is a friend, this group name may be 'friend'. In the 'friend' group, the photos 210b, 220b,... Including the face of 'Kim XX' may be stored. In addition, the grouped images can be managed in synchronization with the user's contacts. Here, the contact may include a contact stored in the user terminal, an address book stored in the SNS account, and the like.

3 is a diagram for explaining a photographing step according to an embodiment of the present invention.

The step of photographing includes displaying (310) a face recognition mark on the face of the subject to be photographed in the photographing mode, displaying registration information matched to the face when a tag is assigned in advance to the face (320) A step 330 of automatically sharing the photographed image with a specific target when the photographed face is a face registered with automatic sharing, and if the tag is assigned in advance to the face after photographed, (Step 340). ≪ / RTI >

In step 310, the face recognition display can be displayed on the face of the photographing target when in the photographing mode. It is possible to distinguish and display whether or not a tag to be photographed is assigned in advance. For example, when the face to be photographed is a face of a specific object to which a tag is assigned in advance, the face recognition display can be represented by a green line. On the other hand, when the face of the object to be photographed is a face of a specific object to which a tag is not assigned in advance, the face recognition display can be represented by a red line.

In step 320, if the face is assigned with a tag in advance, registration information matched to the face can be displayed. Here, the registration information may include a name of a specific object, a telephone number, a contact such as an e-mail, and the like. For example, if the shooting target is 'mother' and a tag is assigned to a face of 'mother' in advance, the face recognition display may be displayed with a green line, and a tag 'Mom' may be displayed together.

In step 330, when the face of the object photographed in the photographing mode is a face registered with automatic sharing, the photographed image can be automatically shared with a specific object at the same time as the photographing. For example, when the shooting target is 'mother' and 'mother' is registered as an automatic sharing target, when shooting 'mom', the image captured at the same time as shooting can be automatically transmitted to 'mom'.

In step 340, if a tag is previously assigned to a face after shooting, the face can be added to the group of images including the face. For example, if the shooting target is 'mother' and a tag is assigned in advance to the face of 'mother', the group name including 'mother' may be 'family'. Then, after shooting 'mom', the photographed image can be added to the 'family' group.

4 is a diagram illustrating a process of displaying a face recognition display according to an embodiment of the present invention.

Referring to FIG. 4, the image includes a specific object 410 and an unregistered object. In the photographing mode for photographing the specific object 410 and the unregistered object, it is possible to distinguish and display whether or not the tag is assigned in advance to the face of the photographing object. For example, a tag is assigned to a specific object 410 in advance, and a tag may not be assigned to an unregistered object. Then, a face recognition mark may be displayed on a face of the specific object 410 by a dotted line 420. On the other hand, a face recognition display may be displayed on the unregistered face with a solid line 430. Here, the face recognition display of the dotted line and the solid line is one example, but is not limited thereto.

In the case of the specific object 410 to which the tag is assigned in advance, registration information matched to the face together with the face display line can be displayed. Here, the registration information may include a name of a specific object, a telephone number, a contact such as an e-mail, and the like. For example, if a tag is assigned in advance to the object of shooting as 'Kim XX' 421, a face recognition mark is displayed by a dotted line 420, and a tag 'Kim XX' 421 is displayed together .

In addition, when the face of the object photographed in the photographing mode is a face registered with automatic sharing, the photographed image can be automatically shared with a specific object simultaneously with the photographing. For example, when 'Kim OO' is registered in advance as an automatic sharing target, when taking 'Kim OO', it is possible to automatically transmit the photographed image to 'Kim OO' at the same time as photographing. If the 'Kim XX' to which the tag is assigned in advance is a friend, the group name of the images including the face of 'Kim XX' may be 'friend'. Then, the image photographed after photographing 'Kim XX' can be added to the 'friend' group.

FIG. 5 illustrates a process of synchronizing a grouped image with a user's contact according to an exemplary embodiment of the present invention. Referring to FIG.

The user's contact may include a contact stored in the user terminal, an address book stored in the SNS account, and the like. Referring to FIG. 5, a user's contact list is shown as an example. It is assumed that the user's contacts include contacts A, B, and C, and their faces are assigned tags in advance. In addition, the user's contact includes a group including images including the names 510, 500, 530, 540, and A, B, C of A, B, 550), and information of the photographs 560 included in this group. For example, the name 510 of the user A, the telephone number 520, the account 530, and the e-mail 540 are stored in the contact of the user. In the electronic album management method according to the embodiment of the present invention, The tag can be assigned in advance. Then, in addition to the information of the name 510, the telephone number 520, the account 530, and the e-mail 540, the user's contact includes a group 550 including images including the face of A, A photograph information 560 can be displayed together. In addition, tags, groups, names, phone numbers, accounts, e-mails, etc., assigned to A's face can be edited by the user.

If the relationship of the user A to the user is a friend and the names of the plurality of photographs taken are X, Y, Z ..., the group of users' contacts displays "friend" .. '. In this way, the grouped images can be synchronized with the user's contacts.

FIG. 6 is a diagram illustrating a configuration of an electronic album management system using a face recognition technology according to an embodiment of the present invention.

The electronic album management system proposed in the present invention may be configured to include a processor 600 including a control unit 610, a storage unit 620, and a communication unit 630, a memory 601, and a network interface 602.

The memory 601 may store a program including an operating system (OS) and an instruction corresponding to the electronic album management system routine. The electronic album management system can efficiently manage the electronic album by synchronizing the image with the contact using the face recognition technology for recognizing the face of the object to be shot. The steps performed in the electronic album management system described with reference to Figs. 1 to 5 may be executed by a program stored in the memory 601. Fig. For example, the memory 601 may be a hard disk, an SSD, an SD card, a cloud storage, and other storage media.

The network interface 602 may couple the electronic album management system to the network for communication with user terminals utilizing the electronic album management system.

The processor 600 is a device for processing according to instructions of a program stored in the memory 601, and may include a microprocessor such as a CPU. The processor 600 may include a control unit 610, a storage unit 620, and a communication unit 630.

The controller 610 may analyze a plurality of images stored in the terminal to recognize a face of a specific object included in the images, and control the tag to be assigned to the face of the recognized specific object. At this time, the face included in at least a predetermined number of images among the images can be automatically recognized. When assigning a tag to a face, the user is asked whether or not to assign a tag to the face. When the user allows the tag, registration information corresponding to the face can be matched. In addition, the face to be automatically shared among the images photographed in the photographing mode can be registered in advance. Further, when a tag is assigned to a face photographed in the photographing mode in advance, the registration information matched to the face can be controlled to be displayed on the display. If a tag is previously assigned to the face after the photographing, the photographed image can be added to the group of images including the face.

The storage unit 620 may store the tag and the registration information by matching registration information corresponding to the face to which the tag is allocated. In addition, it is possible to store the grouped information of the images including the specific object using the tag assigned to the face of the specific object. Then, the grouped images can be stored in synchronization with the user's contacts.

When the tag is assigned to the face, the communication unit 630 can automatically transmit the photographed image to the registered object when automatic sharing is registered.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (10)

Analyzing a plurality of images stored in the terminal and recognizing a face of a specific object included in the images;
Assigning a tag to the recognized face; And
Grouping the images including the specific object using the tag;
Lt; / RTI >
Wherein the step of assigning a tag to the recognized face comprises:
A step of registering the face of the object to be automatically shared among the images photographed in the photographing mode in advance
Gt; < / RTI > The method according to claim 1,
Wherein recognizing a face of a specific object included in the images comprises:
And automatically recognizing a face of a specific object included in at least a predetermined number of images of the images
Electronic album management method. The method according to claim 1,
Wherein the step of assigning a tag to the recognized face comprises:
The user is asked whether or not to assign a tag to the face, and when the user allows the tag, registration information corresponding to the face is matched
Gt; < / RTI > delete The method according to claim 1,
Wherein the grouping of images including the specific object using the tag includes:
The grouped images are managed in synchronization with the user's contacts
Electronic album management method. Analyzing a plurality of images stored in the terminal and recognizing a face of a specific object included in the images;
Assigning a tag to the recognized face; And
Grouping the images including the specific object using the tag;
Lt; / RTI >
Steps to take
Further comprising:
Wherein the photographing step comprises:
Displaying a face recognition mark on a face of a subject to be photographed in a photographing mode;
Displaying registered information matched to the face when a tag is previously assigned to the face; And
Adding a tag to a group of images including the face if the face is previously tagged after the photographing;
Gt; < / RTI > The method according to claim 6,
The step of displaying a face recognition mark on the face of the photographing target in the photographing mode
Whether or not tags are assigned in advance to the face
Electronic album management method. The method according to claim 6,
If the face of the object photographed in the photographing mode is a face registered with automatic sharing, automatically sharing the photographed image with the object simultaneously with photographing
Further comprising the steps of: A controller for assigning a tag to a face of a specific object included in a plurality of images stored in the terminal and grouping the images;
A storage unit for storing the tag and registration information by matching registered information corresponding to a face to which the tag is assigned; And
A communication unit for automatically transmitting an image photographed at the time of photographing to the object registered with the automatic sharing when the tag is assigned to the face,
The electronic album management system comprising: 10. The method of claim 9,
Wherein,
When the tag is assigned to the face of the specific object, the face to be automatically shared can be registered in advance,
When a tag is assigned in advance to the face photographed in the photographing mode, control is performed so that registered information matched to the face is displayed on the display
Electronic album management system.

Images