KR101961024B1 - System for providing information using photo recongition - Google Patents

Abstract

The present invention relates to an information providing system using photo recognition, and more particularly to a system and method for extracting information from a photograph displayed by a user and providing various information in accordance with the extracted information, SNS, etc., and provides information such as matching shopping, thereby creating new economic value. By analyzing the facial expressions of the photographs, etc., the user's psychological state is grasped and personalized information is provided. And an information providing system using photo recognition capable of improving the utility of information.

Description

[0001] The present invention relates to an information providing system using photo recognition,

The present invention relates to an information providing system using photo recognition, and more particularly to a system and method for extracting information from a photograph displayed by a user and providing various information in accordance with the extracted information, SNS, etc., and provides information such as matching shopping, thereby creating new economic value. By analyzing the facial expressions of the photographs, etc., the user's psychological state is grasped and personalized information is provided. And an information providing system using photo recognition capable of improving the utility of information.

With the development of information communication technologies such as the Internet and a smart phone, the user can search various information regardless of the place, and can receive personalized information according to the user's previous Internet use record. As an example of providing personalized information according to the Internet usage information of a user, it is possible to continuously provide matching shopping information by analyzing a keyword previously input in a search site, and to provide information of products previously purchased in a shopping mall To provide information on a new product.

<Patent Literature>

Open Publication No. 10-2001-0047431 (published on June 15, 2001) "Contents shopping system and contents shopping information searching method"

However, since the conventional information providing system provides information in accordance with a user's specific action (search, purchase, etc.), information can not be provided in the absence of active act of searching or purchasing, There is a problem that information can not be provided.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems,

An object of the present invention is to provide an information providing system using photo recognition that can extract information from a photograph displayed by a user and provide various information in accordance with the extracted information.

In addition, the present invention extracts information from a profile photograph such as SNS and provides information such as shopping, etc., even if there is no specific action by the user such as searching and purchasing, so that information using photo recognition The present invention has been made in view of the above problems.

In addition, the present invention provides an information providing system using photo recognition that can improve the efficiency of provided information by analyzing facial expressions and the like of a published photograph to provide personalized information by grasping a psychological state of a user .

In order to achieve the above object, the present invention is implemented by the following embodiments.

According to an embodiment of the present invention, an information providing system using photo recognition according to the present invention includes an information analyzing apparatus for collecting and analyzing a user's photograph and generating and outputting matching information optimized for a user, And a user terminal for displaying the matching information.

According to another embodiment of the present invention, in the information providing system using photo recognition according to the present invention, the information analyzing apparatus includes a photograph collecting unit for collecting and outputting SNS profile photographs at regular intervals, An image analyzing unit for analyzing the image and generating information on an object included in the image, and an information generating unit for generating information for providing matching information including shopping information matching the user using information on the object output from the image analyzing unit And the like.

According to another embodiment of the present invention, in the information providing system using photo recognition according to the present invention, the photo collecting unit accesses the SNS server at regular intervals to collect profile pictures of a specific user, It is judged whether or not one photograph is matched. If the photographs do not coincide with each other,

According to another embodiment of the present invention, in the information providing system using photo recognition according to the present invention, the photograph analyzing unit analyzes the photographs output from the photograph collecting unit, classifies objects included in the photographs, And a psychological recognition unit for analyzing the facial expression in the human image and outputting the psychological state of the user when the information indicating that the person exists in the photograph is output from the image recognition unit, .

According to another embodiment of the present invention, in the information providing system using photo recognition according to the present invention, the information generating unit analyzes the photographs in the photo analyzing unit and, when information on each object is outputted, And generates matching information including shopping information matched to the user, and provides the matching information to the user terminal. In case that the information about the user's psychological state is output from the photo analyzing unit, And a psychological reflection information unit for generating matching information including shopping information on goods and services and providing the matching information to the user terminal.

According to another embodiment of the present invention, in the information providing system using the photo recognition according to the present invention, the psychological awareness part classifies the items as joy, calmness, anger, and fatigue through facial expression analysis, And outputs information indicating that the user is in an abnormal psychological state, including specific item information, and the psychological reflection information unit may be configured to notify the abnormal psychological state of the user when the information on the abnormal psychological state of the user is output from the psychological information obtaining unit, And a psychological information module for generating and outputting shopping information on goods and services that can mitigate the inconvenience.

According to another embodiment of the present invention, in the information providing system using photo recognition according to the present invention, the psychological reflection information part may include information indicating that the specific user output from the psychological information obtaining part is in an abnormal psychological state, A transmission module for transmitting the output shopping information, a price for the goods or services included in the shopping information, and an account number for depositing an amount corresponding to the price, to a user terminal of a person having a relationship with the user; A contract module for establishing a contract for purchasing the specific product or service by accessing a goods service server when receiving a signal indicating that an amount corresponding to a price for the specific product or service has been deposited in the account number transmitted by the transmission module; When the purchase contract is completed by the contract module, Or the information to purchase the service provided to the user informing characterized in that further comprising a module for providing information output to the user terminal.

According to another embodiment of the present invention, in the information providing system using photo recognition according to the present invention, a person who has a relationship with the user is a person who is recorded by the user at the time of subscribing to the information providing service, The information extracting unit refers to the person stored in the storage unit by extracting information of a person who frequently connects with the user through the SNS by connecting to the SNS server at regular intervals.

The present invention can obtain the following effects by the above-described embodiment, the constitution described below, the combination, and the use relationship.

The present invention has an effect of extracting information from a photograph displayed by a user and providing various information in accordance with the extracted information.

In addition, the present invention provides information such as shopping, which is extracted by extracting information from a profile photograph such as SNS, even if there is no specific action by the user such as searching and purchasing, thereby providing new economic value.

In addition, the present invention provides a personalized information by analyzing a facial expression of a published photograph to grasp a psychological state of a user, and thus has an effect of improving the utility of provided information.

1 is a configuration diagram of an information providing system according to an embodiment of the present invention;
FIG. 2 is a block diagram showing a detailed configuration of the analyzer of FIG. 1; FIG.
3 is a block diagram showing the detailed configuration of the photo analyzer of FIG.
FIG. 4 is a block diagram showing a detailed configuration of the psychological unrecorded information part of FIG. 2; FIG.
FIG. 5 is a block diagram showing a detailed configuration of the psychological reflection information unit of FIG. 2;

Hereinafter, preferred embodiments of an information providing system using photo recognition according to the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. Throughout the specification, when an element is referred to as "including" an element, it is understood that the element may include other elements as well as other elements, The terms "part," " module, "and the like denote a unit for processing at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software.

2 is a block diagram showing a detailed configuration of the analyzing apparatus of FIG. 1, FIG. 3 is a block diagram illustrating a detailed configuration of the image analyzing unit of FIG. 2, and FIG. FIG. 4 is a block diagram showing the detailed configuration of the psychological unreported information part of FIG. 2, and FIG. 5 is a block diagram showing the detailed configuration of the psychological reflection information part of FIG.

1 to 5, an information providing system using photograph recognition according to an embodiment of the present invention collects and analyzes a photograph of a user to generate matching information optimized for a user and outputs information And a user terminal 100 for displaying matching information output from the information analyzing apparatus 1. [ The user terminal 100 is configured to transmit user information and receive and display matching information generated by the information analyzing apparatus 1, and is capable of transmitting and receiving information such as a PC, a smart phone, and a tablet PC, A variety of electronic devices capable of displaying can be used.

The information analyzing apparatus 1 collects and analyzes a user's photograph and generates and outputs matching information optimized for a user. The information analyzing apparatus 1 includes a transmitting and receiving unit 11, a registration unit 12, a photograph extracting unit 13, An information generation unit 15, an information extraction unit 16, a storage unit 17, a control unit 18, and the like.

The transceiver 11 transmits and receives information to and from the user terminal 100, the SNS server 200, and the goods service server 300. The SNS server 200 is a server for providing a social network service, for example, a server for providing a social network service such as KakaoTalk, Twitter, Facebook, line, me2day, and the like. The present invention collects and analyzes a user's photograph to provide matching information such as shopping suitable for a user. In view of the fact that most SNS users post their profile photographs and update their photographs frequently according to their recent trends and conditions, The present invention is used to connect to the SNS server 200 to collect user profile pictures and generate user matching information. The commodity service server 300 is a server for selling commodities and services, for example, a server for selling commodities and services such as G-market, Interpark, Timon, Kupang, Melon and the like. In the present invention, shopping information provided to a user can be generated by using information extracted from the goods service server 300. In the present invention,

When the user permits the subscription to the service which allows the user to collect the profile picture of the SNS and provides the personalized information, the registration unit 12 completes the subscription of the service and transmits the information of the user to the storage unit 17 . For example, when a signal for requesting subscription of the service of a specific user and user information are outputted from the server 200 of the SNS provider in a business agreement relation with the service providing company, the registering unit 12 registers the service subscription And stores the user information in the storage unit 17. The user information may include information on the identity such as the user name, the telephone number of the user, the SNS information of the user, the telephone number or SNS information of the other person who has a close relationship with the user, and the like.

The photo collecting unit 13 collects the SNS profile photographs of the users subscribed to the service at regular intervals and outputs them. The photo collecting unit 13 accesses the SNS server 200 at regular intervals, collects profile photographs of specific users, It is judged whether or not the collected photograph matches with the currently collected photograph, and if it does not match, the currently collected photograph is outputted.

The photograph analyzing unit 14 analyzes the photographs output from the photograph collecting unit 13 and generates information about the objects included in the photograph. The photograph recognizing unit 141, the psychological recognizing unit 142, And the like.

The object recognizing unit 141 is configured to analyze the photographs output from the photograph collecting unit 13 to classify the objects included in the photographs and to output information about the objects. A natural module 141a for outputting information indicating that a natural object (river, sea, etc.) exists in the photograph, and an animal module 141b for outputting information indicating that the animal exists in the photograph, A person module 141c for outputting information indicating that a person is present in the photograph when the photograph has an image of the person, and the like. In addition, the human module 141c may classify information about a person into babies and adults and output the information. A variety of existing technologies can be used as the technology for classifying objects (people, animals, natural objects, etc.) in the photographic images by the object recognition unit 141, including known technologies. For example, A method of distinguishing objects from photographic images may be used in the same manner as the recognition method.

When the information recognizing unit 142 outputs information indicating that a person (excluding a baby of a certain standard) exists in the photograph, the psychological recognition unit 142 analyzes the facial expression in the human image included in the photograph, Output the user's psychological state. Specifically, the psychological awareness unit 142 classifies items such as joy, calmness, anguish, and fatigue by facial expression analysis, and when a user corresponds to an angry or fatigue item, the user includes specific items (angry or fatigued) It outputs information informing that it is in an abnormal psychological state. Various techniques may be used to classify the psychological recognition unit 142 into joy, calmness, anger, and fatigue items through facial expression analysis in a photographic image, including known facial recognition techniques. For example, In the image, eyes, balls, and mouth are separated and classified according to the shapes of eyes, balls, and mouth according to the shape of joy, calmness, anger, and fatigue. To specify specific items.

The information generating unit 15 is configured to provide matching information, such as shopping, to be matched to a user using information on the object output from the photograph analyzing unit 14. The information generating unit 15 includes a psychological unrecorded information unit 151, (152), and the like.

When the information about each object is outputted from the photo analyzer 141, the psychic unreflective information unit 151 analyzes the information about the object, generates matching information such as shopping, etc. matching the user, The information analyzing unit 141 analyzes the goods and service information stored in the storage unit 17 when the information that the animal exists in the photograph is analyzed by the photograph analyzing unit 141, And an animal information module 151a for generating and outputting the goods and services stored in the storage unit 17 when the photograph analyzing unit 141 outputs information indicating that natural objects exist in the photographs, (E.g., a book introducing a sea trip, a travel program, a swimming suit, etc., when the information related to the sea is outputted) and outputs the shopping information When the information indicating that the baby exists in the photograph is outputted from the photograph analyzing unit 141, shopping information (such as baby articles) matching with the baby stored in the storage unit 17 is generated And a baby information module 151c for outputting information.

If the psychological state information of the user is output from the photo analyzing unit 14, the psychological reflection information unit 152 generates matching information such as shopping information for goods and services customized to the psychological state of the user, To the terminal 100 and includes a psychological information module 152a, a transmission module 152b, a contract module 152c, an information provision module 152d, and the like.

The psychological information module 152a analyzes the goods and service information stored in the storage unit 17 when the information on the abnormal psychological state of the user is output from the photo analyzer 14 to alleviate the abnormal psychological state of the user And generates and outputs shopping information for the goods and services that can be used. For example, when the abnormal psychological state is tired, shopping information such as music, food, medicines, and services (massage) that can relieve fatigue can be generated and output.

The transmission module 152b transmits the information indicating that the specific user output from the psychological information obtaining unit 142 is in an abnormal psychological state and the shopping information output from the psychological information module 152a to a user terminal (100) or the SNS. The price for the goods service and the account number for depositing the amount corresponding to the price are also transmitted when the shopping information is transmitted by the transmission module 152b. A person who has a friend relationship with the user is informed that the person stored in the storage unit 17 or the information extracting unit 16 to be described later by the user recorded by the user at the time of subscribing to the service is connected to the SNS server 100 And frequently communicates with the user through the SNS.

When the contract module 152c receives a signal indicating that a money corresponding to a price for a specific commodity or a service has been deposited in the account number transmitted by the transmission module 152b from a financial company server (not shown) And connects to the server 300 to conclude a contract to purchase the specific goods or services.

When the purchase contract is completed by the contract module 152c, the information providing module 152d transmits information indicating that a specific person (a person in a friendly relationship) purchases a specific commodity or service and is provided to the user, (For example, if the product or service is music, transmits the purchased music file to the user terminal, and if the product is a fatigue recovery agent, information indicating that a replica of the fatigue is purchased and sent to the courier, and if the massage is a massage, If shopping information has been transmitted by the transmission module 152b but information indicating that the purchase contract has been completed in the contract module 152c is not output within a predetermined period of time, the shopping information output from the psychological information module 152a To the user terminal (100). The present invention not only provides shopping information on a product or service that can extract and smooth an abnormal psychological state such as tiredness or anger in a user's photograph, but also provides information that a specific user is in an abnormal psychological state, The shopping information for the goods or services that can be transmitted is firstly transmitted to the person who has the extracted friendship relationship to induce the user to present the goods or services.

The information extracting unit 16 is connected to the SNS server 200 and the goods service server 300 and extracts information necessary for providing the service. The information extracting unit 16 accesses the SNS server 100 at regular intervals, (Not shown) for extracting information (phone number, SNS information, etc.) of a person who frequently communicates through the SNS and storing the extracted information in the storage unit 17, (Not shown) for collecting information on goods and services currently sold and generating information on goods and services matched to each object, a psychological state, and storing the information on the storage unit 17 ) And the like.

The storage unit 17 stores information used for providing the service. The storage unit 17 stores user information output from the registration unit 12, information collected by the photo collecting unit 13, The control unit 14 controls the information analyzing apparatus 1 based on the setting information serving as the determination reference in the analyzing unit 14 and the analysis information generated in the photograph analyzing unit 14, the information generated in the information extracting unit 16, Information and the like. The control unit 18 controls the overall operation of the information analysis apparatus 1. [

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, Should be interpreted as falling within the scope of.

1: information analyzing apparatus 11: transmitting / receiving unit 12:
13: photograph collecting section 14: photograph analyzing section 15: information generating section
16: information extracting unit 17: storing unit 18:
141: object recognizing unit 142: psychological recognizing unit 151: psychological unrecorded information unit
152: psychological reflection information part 141a: natural module 141b: animal module
141c: human module 151a: animal information module 151b: natural information module
151c: baby information module 152a: psychological information module 152b: transmission module
152c: contract module 152d: information providing module 100: user terminal
200: SNS server 300: goods service server

Claims (8)

An information analyzing device for collecting and analyzing a user's photograph to generate and output matching information optimized for a user and a user terminal for displaying matching information output from the information analyzing device,
The information analysis apparatus includes:
A photo analyzer for analyzing the photo output from the photo collector and generating information about an object included in the photo, and an image analyzing unit for analyzing the SNS profile photo, And an information generating unit for providing matching information including shopping information matched to a user using information about objects,
The photo analyzer may include:
An object recognition unit for analyzing the photographs output from the photo collecting unit to classify objects included in the photographs and outputting information about the objects; And a psychological recognition unit for analyzing the facial expression in the human image and outputting the psychological state of the user,
Wherein the information generating unit comprises:
Analyzing pictures in the picture analyzing unit and analyzing information about the objects when the information about the objects is outputted to generate matching information including shopping information matched to the user and providing the matching information to the user terminal; And a psychological reflection information unit for generating matching information including shopping information on goods and services customized to the psychological state of the user when the information on the psychological state of the user is output from the photo analysis unit and providing the matching information to the user terminal, ,
The psychological analysis unit classifies the items as joy, calmness, anguish, and fatigue through facial expression analysis, and outputs information informing that the user is in an abnormal psychological state,
The psychological reflection information unit,
A psychological information module for generating and outputting shopping information on goods and services that can alleviate the abnormal psychological state of the user when information on the abnormal psychological state of the user is output from the psychological information obtaining unit; The shopping information output from the psychological information module, the price for the goods or services included in the shopping information, and the account number for depositing the amount corresponding to the price, When a signal indicating that a money corresponding to a price for a specific commodity or service has been deposited to the account number transmitted by the transmission module is received, the commodity service server is connected to the commodity service server A contract module for concluding a contract for purchasing the specific product or service, And an information providing module for outputting to the user terminal information informing that a specific person in a friendly relationship purchases a specific product or service and is provided to the user when the purchase contract is completed by the module, . delete The apparatus of claim 1, wherein the photographing unit
Wherein the user is connected to the SNS server at regular intervals to collect profile photographs of a specific user, and judges whether the photographs collected immediately before and the currently collected photographs agree with each other, and outputs the currently collected photographs if they do not match. Delivery system. delete delete delete delete 2. The method of claim 1, wherein the person
A user or an information extracting unit, which is recorded by a user at the time of subscribing to an information providing service and stored in a storage unit by a registration unit, accesses the SNS server at regular intervals and extracts information of a person who frequently communicates with the user through the SNS, Quot; means &quot; means &quot;.&lt; / RTI &gt;

Images