KR20170006778A - System and method for automatic transmitting of portrait photography using face matching - Google Patents
System and method for automatic transmitting of portrait photography using face matching Download PDFInfo
- Publication number
- KR20170006778A KR20170006778A KR1020150097939A KR20150097939A KR20170006778A KR 20170006778 A KR20170006778 A KR 20170006778A KR 1020150097939 A KR1020150097939 A KR 1020150097939A KR 20150097939 A KR20150097939 A KR 20150097939A KR 20170006778 A KR20170006778 A KR 20170006778A
- Authority
- KR
- South Korea
- Prior art keywords
- user
- image content
- matching
- user terminal
- image
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000005540 biological transmission Effects 0.000 claims description 21
- 238000010586 diagram Methods 0.000 claims description 13
- 238000012546 transfer Methods 0.000 claims description 7
- 230000000694 effects Effects 0.000 abstract description 3
- 238000004891 communication Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 230000007423 decrease Effects 0.000 description 3
- 238000010191 image analysis Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/12—Messaging; Mailboxes; Announcements
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
The present invention relates to a method and system for automatically transferring a portrait photograph using face matching, which enables a user who matches a person in the photograph to automatically transmit the photograph.
With the recent development of electronic communication devices, mobile phones widely used and popularized by people have become multifunctional, the camera memory of mobile phones has increased, and various communication infrastructure have been expanded.
As a result, social networks are widely used among people, and content sharing is becoming active.
Specifically, a user who wants to share content using an existing social network registers image content that he wants to share with a server by accessing a server. Accordingly, users who want to share or browse the image contents can access the social network server and browse or download the image content and store the downloaded image content on their mobile phone.
However, since it is necessary to connect to a social network server in order to share contents using a social network, there is a limitation in the location of communication, so that the user can directly and conveniently transmit Demand is spreading.
Accordingly, Korean Patent Laid-Open No. 10-2014-0135320 has developed an image analysis technique using an advanced image analysis technique in which a face stored in a mobile phone address book is compared with a face and a photograph is automatically transferred to a contact of a matching face.
However, in the case of a method of transmitting a photo using a conventional address book, a photograph stored in a mobile phone address book is obtained by comparing the photo with a photograph to be transmitted.
And there is a problem that the photograph can not be transmitted if the contact information of a friend who wants to transmit the picture is not in the address book of the mobile phone.
In addition, in order to solve the above-mentioned problems, in the prior art, it is necessary to construct an address book including a large amount of images in a mobile phone, thereby realizing an effective invention.
In this case, however, there is a problem that the mobile phone terminal needs to execute a search processor for an input image and an enormous amount of address book, so that an overload of the mobile phone terminal occurs or a mobile phone itself requires a more advanced system than necessary.
SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for transmitting image content to a person who does not know a contact, The present invention provides a method and system for automatically transferring a portrait photograph using face matching.
The present invention provides a method and system for automatically transferring a plurality of images to a user image stored in a database of a server using face matching to increase the matching probability between image contents and user information.
The present invention also provides a method and system for automatically transferring a portrait photograph using face matching for setting an index according to the degree of user relationship and for matching user information and image content according to the index order, .
According to an aspect of the present invention, there is provided an image processing apparatus including a user terminal, a server, and a user terminal. The image processing apparatus compares image content with a registered image of a user, The method comprising the steps of: (A) transmitting, by a user terminal, image content to a server; (B) extracting an object region from the image content and sequentially matching the object region with a user DB; (C) extracting the matching user data by identifying a user who matches the person in the target area; And (D) transmitting the image content to the user terminal that has been matched.
In the image content of the step (A), a target area of the imaged content may be designated from the user terminal.
The matching in step (B) may be matched according to a degree of relationship, which is an index indicating the degree of relation between a user for determining a priority for matching and a user registered in the user DB.
The degree of relationship may be a value calculated from transmission history of the user and transmission histories of users included in the user DB.
On the other hand, the relationship diagram is calculated by the equation X = n (1-Y) + (Z * m): where X is the relationship diagram, Y is the relationship degree, Z is the number of image content transfers between the user or users; n, respectively, can be the relationship decrease or decrease with increasing directivity, and m can be the increase with relation to transmission frequency.
The step (D) may further include: (D11) providing the user list extracted in the step (C) to the user terminal; (D12) receiving the transmission request message from the user terminal, and transmitting the image content to the user terminal requested to be transmitted.
The user list of the step (D11) may be arranged in descending order according to the degree of matching of the matched users when two or more matched users are discriminated in the step (C).
The step (D) may further include: (D21) storing the image content in a server and registering the image content; (D22) transmitting an image content registration message to the user terminal extracted in the step (C); And (D23) receiving the image content transmission request message from the user terminal and transmitting the image content to the user terminal.
Further, the present invention provides a method of managing a user relationship, comprising the steps of: (E) (F) The server counts the number of times of discrimination with respect to the user registration image to reset the basic image.
(G) receiving account information of the image content receiving means of the target area person designated by the user terminal, if the matching user is not determined in the step (C) of the present invention; (H) transmitting the image content to the account information of the input image content receiving means; (I) comparing the account information of the image content receiving means with a user DB, and registering the account information as new user information if the account information is not registered, wherein the user information includes a basic image and account information of the image content receiving means And the like.
If the account information of the image content receiving means is registered in the user information as a result of the comparison in the step (I), the basic image of the user stored in (J) may be changed into the target area of the image content .
If two or more basic images are registered, the matching of step (B) sequentially matches the registered images with respect to each user; In the basic image resetting in the (F) step, the matching order may be set according to the number of times of matching.
The present invention provides an automatic picture transfer system using face matching, which comprises a user terminal, a server and a user terminal, for transmitting the image contents to a matching user terminal by comparing image contents with registered images of a user, A user terminal for transmitting image content to a server; A server extracting a target area from the image content, determining a user who matches the person in the target area, and transmitting the image content to the matching user terminal; And a user terminal for receiving the image content, wherein the server comprises: a transceiver for transmitting and receiving the image content; A control unit for extracting a target area from the image content and determining a user matching the person in the target area; A face recognition unit for recognizing a face of a person in the target area; And a database including a user information DB for storing user information using the automatic portrait photographing system and an image content DB for storing the image contents.
The following effects can be expected in the method and system for automatic transfer of portrait photographs using face matching according to the present invention as described above.
That is, according to the present invention, the image content is transmitted to the matched user terminal by matching the user information stored in the database of the server with the image content, so that the image content can be transmitted to an acquaintance who does not know the contact.
The present invention has the effect of increasing the probability of matching the user information with the image content by registering a plurality of images in the user information stored in the database of the server.
In addition, according to the present invention, an index according to the degree of user relationship is set, and the matching of the user information and the image content is performed according to the index order, thereby shortening the matching time.
1 is a block diagram showing a configuration of an automatic portrait photographing system using face matching according to the present invention.
2 is a flowchart illustrating a method for automatically transferring a portrait photograph using face matching according to the present invention.
3 is a diagram illustrating an example of designating a target area of image content in a method of automatically transferring a portrait image using face matching according to the present invention.
FIG. 4 is a flowchart illustrating a method of matching a user DB and a target area in a method for automatically transferring a portrait image using face matching according to the present invention. FIG.
FIG. 5 is a diagram illustrating an example in which a relative directivity is calculated in a method of automatically transferring a portrait photograph using face matching according to the present invention; FIG.
FIG. 6 is an exemplary view showing an example of a matched user list received by a user terminal in an automatic method for transferring portrait photographs using face matching according to the present invention. FIG.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a method and system for automatically transferring portrait photographs using face matching according to a specific embodiment of the present invention will be described with reference to the accompanying drawings.
1 is a block diagram showing a configuration of an automatic portrait photographing system using face matching according to the present invention.
As shown in the figure, an automatic portrait photographing system using face matching according to the present invention includes a
The
The
Here, the target area is a recognition area matching with a registered image of a user, and a user can designate one or more target areas.
The
First, the
The
In this case, the relationship diagram is a value that sets the degree of relation between the user and the user to determine the matching priority according to the present invention.
After transmitting the image content, the
In addition, the
At this time, the user information includes at least one registered image and account information of the image content receiving means, and a registered image having the largest number of times of discrimination is set as a basic image.
Meanwhile, the
Hereinafter, an embodiment of a method for automatically transmitting a portrait photograph using face matching according to the present invention will be described in detail with reference to FIG.
FIG. 2 is a flowchart illustrating a method for automatically transferring a portrait photograph using face matching according to the present invention.
As shown in FIG. 2, the automatic method of transferring a portrait photograph using face matching according to the present invention includes an application (hereinafter referred to as an "application "Quot;) (S110).
Then, the
In the present invention, the
For example, as shown in FIG. 3, a recognition area indicated by a solid line, that is, a recognition area of a person A, a person B, and a character E among the five recognition areas existing in the image content is designated as a target area, The person C and the person D, which are recognition areas indicated by dotted lines, can be prevented from being included in the target area.
In this case, the
Meanwhile, the
Hereinafter, the registered image of the user information stored in the
As shown in FIG. 4, the
Therefore, the relationship diagram (X) can be basically expressed as the following Equation (1).
In applying Equation (1), X is a relationship diagram, Y is a relation directivity which is a relation level between a user and a user, Z is a number of image content transfers between a user or users, The relationship is also a decline, and m is an increase in the relationship with the number of transmissions.
That is, Equation (1) indicates that the degree of relation (X) is higher as the degree of directivity (Y) is lower and as the number of transmissions (Z) is greater.
At this time, the n and m are set by the administrator of the
On the other hand, a method of calculating the relative directivity Y will be described in detail with reference to FIG.
For example, as shown in FIG. 5, when there is a history that the user A has transmitted image content to the users A, B, C, D, and E, The directivity (Y) of "A" to users "A", "B", "C", "D"
When there is a history that the user "A" has transmitted image contents to the users "a", "b", "c", "d", and "e" b "," c "," d "," e "The directivity (Y) is 2.
Further, when there is a history that the user "c" has transmitted the image content to the users "?", "?", And "?" The relative directivity (Y) is 3.
Accordingly, not only the users who have the history of transmitting the image contents but also the users who have transmitted the image contents to the users who have transmitted the image contents can establish a relationship diagram, The time required for matching can be shortened.
After setting a user-centered index according to the relation diagram X (S171), when a command for matching the registered image of the user information with the target area is input, matching is performed according to the index order S173).
A candidate group list is generated according to the degree of matching between the registered image of the user information and the target area character (S175).
Thereafter, the
In this case, if all of the designated target areas are not determined, the step of matching the registered image of the user information with the person of the target area (S170) is repeatedly performed.
Meanwhile, after extracting all the user data in the present invention, the embodiment is divided into three types.
First, the first embodiment transmits the image content to the
This is to provide a convenient automatic transmission service to the user without any special procedure.
The second embodiment provides a user list determined by the user terminal 100 (S210).
Thereafter, the
Here, the user list may be output to the
At this time, the user list includes only the matching image with the registered image of the user, which may cause a social problem such as obtaining the account information of the image content receiving means by using the app after shooting the other without permission .
To this end, the user list may display only a part of the account information of the image content receiving means, or may display only the registered image of the user to protect the personal information.
Through this process, the image content can be transmitted to an acquaintance who does not know the account information of the image content receiving means.
In the third embodiment, the
Then, the
The
Accordingly, the
If the matching user is not determined as a result of step 180, the
Upon receiving the message, the
At this time, if the account information of the image content receiving means is not stored in the
When the
Thereafter, the relationship diagram X is reset (S330) as the directivity Y and the number of transmissions Z are changed for the user.
Then, the number of discrimination for the registered image of the user is counted (S340), and the registered image having the largest number of discriminations is reset to the basic image (S350).
This is to shorten the matching time because the primary image is first matched with the designated target area from the user.
It will be understood by those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the appended claims. It is self-evident.
In the meantime, the present invention automatically receives account information of image content receiving means of people who take a picture while photographing image contents, by using short-range wireless communication such as Bluetooth, and then transmits the account information to the
In addition, the present invention can also use a method of automatically transmitting the image content to the
The present invention relates to a method and system for automatic transfer of a portrait image using face matching, which enables a user to automatically transmit the photo to a user matching a person in the photograph. The present invention relates to a method and system for automatically matching a user, Since the image content is transmitted to the matched user terminal, the image content can be transmitted to an acquaintance who does not know the contact.
100: user terminal 200: server
210: Transmitting / receiving unit 220:
230: face recognition unit 240: database
242: User information DB 244: Image content DB
300: User terminal
Claims (13)
(A) the user terminal transmitting image content to a server;
(B) extracting an object region from the image content and sequentially matching the object region with a user DB;
(C) extracting the matching user data by identifying a user who matches the person in the target area; And
(D) transmitting the image content to the user terminal that has been matched.
The image content of the step (A)
And the object area of the imaged contents is designated from the user terminal.
The matching of step (B)
Wherein the matching is performed according to a degree of relationship between a user for determining a priority for matching and an index indicating a degree of relation between users registered in the user DB.
The above-
And a value calculated from the transmission history of the user and the transmission histories of the users included in the user DB.
The above-
Is calculated by the following equation: X = n (1-Y) + (Z * m)
Where X is a relationship diagram, Y is a relationship directivity that is a relationship class between a user and a user, Z is the number of image content transmissions between a user or users;
n is a relationship between degrees of directivity increase and m is an increase in relation with the number of transmissions, respectively.
The step (D)
(D11) providing the user list extracted in the step (C) to the user terminal;
(D12) receiving the transmission request message from the user terminal, and transmitting the image content to the user terminal requested to be transmitted.
The user list of the (D11)
If two or more matching users are identified in the step (C)
And the matching users are listed in descending order according to the matching degree.
The step (D)
(D21) storing the image content in a server and registering the image content;
(D22) transmitting an image content registration message to the user terminal extracted in the step (C); And
(D23) receiving the image content transmission request message from the user terminal, and transmitting the image content to the user terminal.
(E) the server re-establishing a relationship of the user;
(F) counting the number of discrimination for the user registration image by the server and resetting the basic image.
If no matching user is determined in the step (C)
(G) receiving account information of the image content receiving means of the target area person designated from the user terminal;
(H) transmitting the image content to the account information of the input image content receiving means;
(I) comparing the account information of the image content receiving means with a user database and registering the account information as new user information if it is not registered,
Wherein the user information comprises a basic image and account information of the image content receiving means.
If the account information of the image content receiving means is registered in the user information as a result of the comparison in the step (I)
(J) changing the basic image of the user stored as the target area of the image content.
If more than one base image is registered,
The matching of step (B) may include sequentially matching registered images for each user;
Wherein the matching procedure is set according to the number of times of matching the basic images in the step (F).
A user terminal for transmitting image content to a server;
A server extracting a target area from the image content, determining a user who matches the person in the target area, and transmitting the image content to the matching user terminal; And
And a user terminal receiving the image content,
The server comprises:
A transmitting and receiving unit for transmitting and receiving the image contents;
A control unit for extracting a target area from the image content and determining a user matching the person in the target area;
A face recognition unit for recognizing a face of a person in the target area; And
And a database configured to include a user information DB for storing user information using the automatic portrait photographing system and an image content DB for storing the image content.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150097939A KR20170006778A (en) | 2015-07-09 | 2015-07-09 | System and method for automatic transmitting of portrait photography using face matching |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150097939A KR20170006778A (en) | 2015-07-09 | 2015-07-09 | System and method for automatic transmitting of portrait photography using face matching |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20170006778A true KR20170006778A (en) | 2017-01-18 |
Family
ID=57992296
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150097939A KR20170006778A (en) | 2015-07-09 | 2015-07-09 | System and method for automatic transmitting of portrait photography using face matching |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20170006778A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20200076273A (en) * | 2018-12-19 | 2020-06-29 | 라인플러스 주식회사 | Method and system for managing image based on interworking face image and messenger account |
WO2022196906A1 (en) * | 2021-03-15 | 2022-09-22 | 삼성전자 주식회사 | Electronic device, operating method of electronic device, and recording medium |
WO2024039073A1 (en) * | 2022-08-18 | 2024-02-22 | 삼성전자 주식회사 | Electronic device for applying effect to image and control method thereof |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20140135320A (en) | 2013-05-15 | 2014-11-26 | 주식회사 엘지유플러스 | System and method for photo sharing by face recognition |
-
2015
- 2015-07-09 KR KR1020150097939A patent/KR20170006778A/en unknown
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20140135320A (en) | 2013-05-15 | 2014-11-26 | 주식회사 엘지유플러스 | System and method for photo sharing by face recognition |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20200076273A (en) * | 2018-12-19 | 2020-06-29 | 라인플러스 주식회사 | Method and system for managing image based on interworking face image and messenger account |
US11609976B2 (en) | 2018-12-19 | 2023-03-21 | LINE Plus Corporation | Method and system for managing image based on interworking face image and messenger account |
WO2022196906A1 (en) * | 2021-03-15 | 2022-09-22 | 삼성전자 주식회사 | Electronic device, operating method of electronic device, and recording medium |
WO2024039073A1 (en) * | 2022-08-18 | 2024-02-22 | 삼성전자 주식회사 | Electronic device for applying effect to image and control method thereof |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10009731B2 (en) | Information sharing method, device and storage medium | |
US9911002B2 (en) | Method of modifying image including photographing restricted element, and device and system for performing the method | |
JP5995520B2 (en) | Image processing support system, information processing apparatus, and image processing shadow support method | |
US8953835B2 (en) | Mobile terminal and method for forming human network using the same | |
US20070162971A1 (en) | System and method for managing captured content | |
CN110418064B (en) | Focusing method and device, electronic equipment and storage medium | |
KR101534808B1 (en) | Method and System for managing Electronic Album using the Facial Recognition | |
US9122910B2 (en) | Method, apparatus, and system for friend recommendations | |
WO2020111776A1 (en) | Electronic device for focus tracking photographing and method thereof | |
JP2014099763A (en) | Photographing service system and photographing control method | |
KR20170006778A (en) | System and method for automatic transmitting of portrait photography using face matching | |
KR100706912B1 (en) | System and method for mapping photo according to position | |
TW201913484A (en) | Image display method and device and electronic device | |
US20170249308A1 (en) | Image tagging | |
JP2013045138A (en) | Information providing system, information providing apparatus, information providing method, communication terminal and program | |
KR20200081892A (en) | System for managing electric business card and method therefor | |
KR100853379B1 (en) | Method for transforming based position image file and service server thereof | |
KR20120052569A (en) | Method for providing image management based on user information and device and system using the same | |
CN109074367B (en) | Method for determining terminal held by object in photo and terminal thereof | |
KR101913324B1 (en) | Method for providing image management based on user information and device and system using the same | |
CN111064892A (en) | Automatic image sharing method and system, electronic device and storage medium | |
CN107241437B (en) | Data processing method and device | |
WO2023162255A1 (en) | Information provision device, information provision method, and non-transitory computer-readable medium | |
KR102278017B1 (en) | Method for social networking service based on photos | |
JP7351048B2 (en) | Social network service support system, social network service support method, social network service support program, and terminal device |